jbaczek

Add mcore full TE transformer layer spec

4

# What does this PR do ? Add spec for model built from te.TransformerLayer **Collection**: nlp # Changelog - Add specific line by line info of high level changes in...

Wrap all fp8 extra states in LocalNonpersistentObject

1

# What does this PR do ? This PR generalizes FP8 extra state wrapping for all tensors. **Collection**: nlp # Before your PR is "Ready for review" **Pre checks**: -...

[Draft] Use FP8 in GPT TP2 test

1

# What does this PR do ? Add a one line overview of what this PR aims to accomplish. **Collection**: [Note which collection this PR will affect] # Changelog -...