Eric Alcaide
Eric Alcaide
hm not that i was aware of. It was pretty much the same. The thing i saw that could help significantly is in the final construction of suggestion, which uses...
is it working for you??
what are your thoughts on GPU acceleration or at least multi-core in CPU? In python it's really easy with joblib, cupy, jax... Don't know about the julia set of tools...
I see... whats a reasonable timeframe in which this might get implemented?
@lucidrains so i tried it for the memory-efficient attention but couldn't get it to work faster than the original (the difference was so small it wasn't justified...) so i guess...
very nice!
Posting here as well since it might be helpful for others: 1. i think you might run in trouble with PyG dataloaders: it merges different graphs into one big graph...
Same could be done in AF2 btw
Now also allows to do a linear projection of edges and features before passing them to the transformer.
Hi there! I think in principle there's no reason to use them, although if you try, pls report your results. Best, Eric