TransformerEngine icon indicating copy to clipboard operation
TransformerEngine copied to clipboard

Support DeepSeek FP8 recipe in JAX

Open nvMelissa opened this issue 3 months ago • 0 comments

Is your feature request related to a problem? Please describe. N/A

Describe the solution you'd like Support DeepSeek FP8 recipe in JAX. Already supported in Pytorch.

Describe alternatives you've considered N/A

Notes/ Additional context Blockscaled activations and layernorm are optimizations and not needed for functionality

nvMelissa avatar Nov 03 '25 03:11 nvMelissa