ms-swift icon indicating copy to clipboard operation
ms-swift copied to clipboard

GLM4V运行时报错

Open det-tu opened this issue 1 year ago • 3 comments

Describe the bug What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图) 命令:CUDA_VISIBLE_DEVICES=0 swift infer --model_type glm4v-9b-chat --model_id_or_path ../MLLM/GLM4V-9b --template_type glm4v 报错:AssertionError: failed to match chat template, please explicit set chat_template_config image

Your hardware and system info Write your system info like CUDA version/system/GPU/torch version here(在这里给出硬件信息和系统信息,如CUDA版本,系统,GPU型号和torch版本等)

image

Additional context Add any other context about the problem here(在这里补充其他信息)

det-tu avatar Aug 06 '24 13:08 det-tu

lmdeploy是什么版本

Jintao-Huang avatar Aug 06 '24 16:08 Jintao-Huang

lmdeploy是什么版本

lmdeploy是0.5.2,swift是2.3.0.dev0

det-tu avatar Aug 07 '24 02:08 det-tu

lmdeploy是什么版本

请问下是版本问题吗,看文档里没写swift对应该装哪个版本的lmdeploy

det-tu avatar Aug 09 '24 13:08 det-tu

我用swift2.4.0.dev0, lmdeploy=0.5.3也没办法跑通glm4v 的lmdeploy inference代码

问题是AttributeError: 'AsyncEngine' object has no attribute 'vl_encoder' 看了下lmdeploy代码, 应该是lmdeploy没有成功建立vlAsyncEngine这个类

demoninpiano avatar Aug 16 '24 08:08 demoninpiano

Describe the bug What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图) 命令:CUDA_VISIBLE_DEVICES=0 swift infer --model_type glm4v-9b-chat --model_id_or_path ../MLLM/GLM4V-9b --template_type glm4v 报错:AssertionError: failed to match chat template, please explicit set chat_template_config image

Your hardware and system info Write your system info like CUDA version/system/GPU/torch version here(在这里给出硬件信息和系统信息,如CUDA版本,系统,GPU型号和torch版本等)

image

Additional context Add any other context about the problem here(在这里补充其他信息)

这个问题已经修复了

Jintao-Huang avatar Aug 21 '24 02:08 Jintao-Huang

Describe the bug What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图) 命令:CUDA_VISIBLE_DEVICES=0 swift infer --model_type glm4v-9b-chat --model_id_or_path ../MLLM/GLM4V-9b --template_type glm4v 报错:AssertionError: failed to match chat template, please explicit set chat_template_config image Your hardware and system info Write your system info like CUDA version/system/GPU/torch version here(在这里给出硬件信息和系统信息,如CUDA版本,系统,GPU型号和torch版本等) image Additional context Add any other context about the problem here(在这里补充其他信息)

这个问题已经修复了

你好,想问一下你是怎么解决的问题吗,我也遇到了一样的问题

Aanlifire avatar Nov 25 '24 08:11 Aanlifire