Jeremy Malloch

icon indicating a website link malloch.ca icon indicating an email [email protected]

icon company @climatix-ai icon location San Francisco, California icon location Physics Foundation Models at Causal Labs | Ex Cruise Perception

Results 3 comments of Jeremy Malloch

{count}gt command not jumping to correct tab

I also have this issue.

[question] Myelin: attention fusion and FlashAttention

Hey, a couple questions to tack on: 1. What version of TensorRT will this be included in? Is that TRT 8.7? And if `--profilingVerbosity=detailed` dumps the data, does that mean...

[question] Myelin: attention fusion and FlashAttention

Hey, one followup question. How does the fusion scheme work for pre-norm transformers (as the layer norm would only be applied to the residual branch, and not the identity branch)?...