Zhuguanyu Wu comments

Repositories
Issues
Comments

Results 2 comments of


                                            Zhuguanyu Wu

Hello! May I inquire if the LayerNorm module has not been quantized in this model?

Thank you! And I have another question. In FQ-ViT, both the softmax and LayerNorm layers are computed in integer form. So, would it be unfair to compare the accuracy of...

wan i2v-14b-720p蒸馏模型问题

1. 目前的模型是同时完成的。我们也做了一个带有cfg-embedding的方案，可能会在后续发布。蒸馏方案是dmd2。 2. 固定5.0 3. 大约3w+的数据量，48卡H100