evo
evo copied to clipboard
evo-design
NameError: name 'swap_mha_rope' is not defined"
When I try to load the model, I encounter the following issue. There is a related issue, but it has not solved my problem. NameError: name 'swap_mha_rope' is not defined"
Related versions are as follows:
import torch, triton, flash_attn print(torch.__version__, torch.version.cuda, triton.__version__, flash_attn.__version__)
2.3.1+cu121 12.1 2.3.1 2.6.3
