FontMLLM

多卡推理qwen2.5-vl-7B的时候张量并行报错

5

CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 torchrun --nproc-per-node=8 run.py --data MMBench_TEST_EN MMBench_TEST_CN MMStar MME MMMU_TEST Q-Bench1_TEST --model Qwen2.5-VL-7B-Instruct --verbose 报错： ` File "/home/zhoupc/anaconda3/envs/qwen/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/zhoupc/anaconda3/envs/qwen/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1845,...