cannot import name 'rotate_half' from 'sat.model.official.llama_model'

[kkkwjr]

python cli_demo_sat.py --from_pretrained cogagent-chat --version chat --bf16 --stream_chat [2024-11-28 05:54:25,880] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) Traceback (most recent call last): File "/workspace/kkkjr/Item/CogVLM/basic_demo/cli_demo_sat.py", line 12, in from utils.utils import chat, llama2_tokenizer, llama2_text_processor_inference, get_image_processor File "/workspace/kkkjr/Item/CogVLM/utils/utils/init.py", line 2, in from .language import llama2_tokenizer, llama2_text_processor, llama2_text_processor_inference File "/workspace/kkkjr/Item/CogVLM/utils/utils/language.py", line 1, in from sat.model.official.llama_model import LLaMAModel, rotate_half ImportError: cannot import name 'rotate_half' from 'sat.model.official.llama_model' (/home/wpg/anaconda3/envs/CogAgent/lib/python3.9/site-packages/sat/model/official/llama_model.py)

为啥会出现引入不了 'rotate_half'的情况呢

[xjywhu]

也遇到了一样的问题，请问您解决了吗

[Adam-ly-captain]

pip install SwissArmyTransformer==0.4.9 解决rotate_half问题