CogAgent
CogAgent copied to clipboard
can't running on windows
System Info / 系統信息
windows11 Python 3.10.16 torch 2.5.1+cu121 torchaudio 2.5.1 torchvision 0.20.1
Who can help? / 谁可以帮助到您?
No response
Information / 问题信息
- [x] The official example scripts / 官方的示例脚本
- [ ] My own modified scripts / 我自己修改的脚本和任务
Reproduction / 复现过程
A error happen as the above image when I run follow cmd:
python inference/cli_demo.py --model_dir D:\models\cogagent-9b-20241220 --platform "WIN" --max_length 4096 --top_k 1 --output_image_path ./results --format_key status_action_op_sensitive
As the image show, I don't what error happy, only stop runing.
Expected behavior / 期待表现
startup the scripts
显存不够,内存也不够。。 需要28G显存和内存运行BF16