Jeeva Selvam
Jeeva Selvam
`where(arange(j)[:, None] == arange(j), (outer(ones(j), ones(j))), 0)`
Took a further look and visualized the sparsity by plotting the csr matrix using pyplot.spy, seems like there are banded regions with block sparse patterns. Some context, I am trying...
I have begun to hack on this in my free time, fortunately https://github.com/NicolaLancellotti/metal-dialect provides some good examples of lowering mlir to metal
https://github.com/facebookresearch/xformers/blob/main/xformers/ops/_triton/k_index_select_cat.py There’s this in xformers seems similar to indexing into a sparse tensor