Lanture1064

## Why are these changes needed? When using langchaingo w/ fastchat, it generates requests with formats like `"messages":["text":"given text", "type": "text"]` as default, which will be recognized and processed as...

Currently the `--max-model-len` can be passed to vllm through `kwarg`, but could it be added to the default param like `gpu-utilization-limit`? It is often needed when using models that can...

[BUG] 无网络环境下模型 tokenizer 无法加载，错误为读取不到模型目录下的 SimSun.ttf 文件

15

### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this? - [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions ### 该问题是否在FAQ中有解答？ | Is there an...

多卡4090 DeepSpeed ZeRO-3 LoRA 微调 Qwen2.5-14B-Instruct 显存占用超出预期

4

### Reminder - [X] I have read the README and searched the existing issues. ### System Info - `llamafactory` version: 0.9.1.dev0 - Platform: Linux-5.15.0-97-generic-x86_64-with-glibc2.35 - Python version: 3.12.3 - PyTorch...