Jeeva Selvam

Results 5 comments of Jeeva Selvam

`where(arange(j)[:, None] == arange(j), (outer(ones(j), ones(j))), 0)`

Took a further look and visualized the sparsity by plotting the csr matrix using pyplot.spy, seems like there are banded regions with block sparse patterns. Some context, I am trying...

I have begun to hack on this in my free time, fortunately https://github.com/NicolaLancellotti/metal-dialect provides some good examples of lowering mlir to metal

https://github.com/facebookresearch/xformers/blob/main/xformers/ops/_triton/k_index_select_cat.py There’s this in xformers seems similar to indexing into a sparse tensor