Bissmella Bahaduri issues

Repositories
Issues
Comments

Results 1 issues of


                                            Bissmella Bahaduri

Add Unified Sequence Parallel attention

# What does this PR do? This is a draft implementation of the Unified SP attention approach. - Implements `_all_to_all_dim_exchange` with custom scatter and gather indices - Implements `TemplatedUnifiedAttention` Core...