wangyifei

dashinfer_vlm_serve --model models/Qwen2-VL-2B-Instruct-GPTQ-Int8 报错 KeyError: 'q_proj.weight'

9

Traceback (most recent call last): File "/usr/local/bin/dashinfer_vlm_serve", line 33, in sys.exit(load_entry_point('dashinfer-vlm', 'console_scripts', 'dashinfer_vlm_serve')()) File "/root/code/dashinfer_vlm/api_server/server.py", line 683, in main init() File "/root/code/dashinfer_vlm/api_server/server.py", line 93, in init model_loader.load_model(direct_load=False, load_format="auto") File "/root/code/dashinfer_vlm/vl_inference/utils/model_loader.py",...