model-name和chat template绑定的吗？

[yileld]

这是我的命令 lmdeploy serve api_server /mnt/data/OmChat-40B-IV --backend pytorch --server-port 8000 --model-name my_model_abc

报错 ValueError: You are using base template to handle chat task. Please specify a --chat-templatename chosen fromlmdeploy list if you want to use OpenAI messages input.

所以我不能任意改model-name，否则就得自己指定chat template？

[lvhan028]

不绑定。看下你的模型中是不是没有对话模板？

[github-actions[bot]]

This issue is marked as stale because it has been marked as invalid or awaiting response for 7 days without any further response. It will be closed in 5 days if the stale label is not removed or if there is no further response.

[github-actions[bot]]

This issue is closed because it has been stale for 5 days. Please open a new issue if you have similar issues or you have any new updates now.