ChangeFWorld

Results 3 comments of


                                            ChangeFWorld

Interesting Work. Hope for releasing of code/model.

Any plan of code release？

你好，比如llama这些LLM模型，我看统计的结果好像没有包括attention矩阵的[email protected]那部分计算量。

+1，确实是这样的，attention的flops完全没有被考虑

Why are `torch.mm` and `torch.bmm` deleted in pytorch_ops.py

> 谢谢，MrYx已经收到您的邮件! encounter the same bug. Any update?