ClclEl

Results 1 comments of ClclEl

[Bug] lmdeploy部署intermlm2-chat-20b，遇到<|im_end|>不会停止

两种方法，第一种是官网给的方法，写成在json里，启动的时候在`--chat-template`这个参数传入 ![screenshot-20240911-172812](https://github.com/user-attachments/assets/f6c2d4f2-6f59-4107-9b7d-1d9ceadc35c1) ![screenshot-20240911-172834](https://github.com/user-attachments/assets/dfb5268b-3480-4550-a2b7-60a6ab0a0fc2) 第二种方法，在使用调用openAI格式的API时，设置停止词`stop=["", ""],` ![image](https://github.com/user-attachments/assets/aab0b7bd-cf39-4500-845b-4c30e7faa0a5)