Godlovecui

> What docker image do you use? Also, could you share your transformers version? I cannot reproduce such issue on my side. 1. I built an environment in AutoDL cloud(https://www.autodl.com/market/list),...

OK, I will try official docker image in the future. This issue is closed temporarily. It will reopen if I encounter same question in the future. Thank you~~~

When I add fake key of "name" in config.json, it raises below error: 

which copy operation and copy traits should I follow? When I use: using g2s_copy_op = SM80_CP_ASYNC_CACHEGLOBAL, it raises below error:  how to fix it? Thank you~ @kf-zhang @tmm1 @kerrmudgeon...

This is my github commit, gemm-multi-stage_e4m3_v2.cu is my test code for e4m3. I add MMA atoms in 3rd/cutlass/include/cute/arch/mma_sm80.hpp, https://github.com/Godlovecui/cute-gemm/commit/c0168852a3a62e76dd0de33e05b410510aa02837#diff-2e927406d89afc8be5b4c85da736860c23e0eac8e871bbe8c0ebbe7ebf67fe7c Thank you very much~ @thakkarV

This is my new commit, which only contain my modified code, Thank you for your help~ @thakkarV https://github.com/Godlovecui/cute-gemm/commit/d7fdb5dc0910fc0a788f466195886233c473331b gemm-multi-stage_e4m3_v2.cu is my modified code for support FP8. The step to reproduction:...

> I left a review on your code ok, I try and modify it according to your review, thank you very much. @thakkarV

Hi, Can TransformerEngine be compiled into a pip package，if I want to use transformerEngine in vLLM. Thank you~ @timmoon10

> Not yet for now Hi, @tridao Do you think what is the key difficult in support FP8? Or, do you have any schedule for support in the future? Thank...

Hi, @danthe3rd: Do you think what is the key difficult in full support FP8? Or, do you have any schedule for full support in the future? Thank you~