Rafael Alberto Rivera Soto

icon indicating a website link https://scholar.google.com/citations?user=4rCvH-UAAAAJ&hl=en icon indicating an email [email protected]

icon company @LLNL icon location Maryland icon location @LLNL @JHU-CLSP

Results 1 issues of Rafael Alberto Rivera Soto

Correct way to deal with padded inputs?

7 comment

Hello Everyone, I'm looking to use the standalone S4D replacement layer [here](https://github.com/HazyResearch/state-spaces/blob/main/src/models/sequence/ss/standalone/s4d.py) as a drop-in replacement to the attention mechanism in a transformer model. I'm wondering what is the best...