Dahun Kim issues

Repositories
Issues
Comments

Results 1 issues of


                                            Dahun Kim

Shape of relative position encoding r^q, r^k, r^v

If the span-size `K` is smaller than the width `W`, then do we have the size of `(C,W,K)` for the relative position encoding matrix `r^q`? So that it's `einsum`ed with...