Aatrox1024 comments

Repositories
Issues
Comments

Results 2 comments of


                                            Aatrox1024

[Bug] model-kwargs参数和generation-kwargs参数无法通过CLI命令行指定

I encountered the same issue and found that it may be caused by a bug in [https://github.com/open-compass/opencompass/blob/0.5.1.post1/opencompass/utils/run.py#L316](https://github.com/open-compass/opencompass/blob/0.5.1.post1/opencompass/utils/run.py#L316), where the `generation_kwargs` parameter is missing when generating VLLMwithChatTemplate model config. ```python acc_model...

[Bug] VLLM推理时参数不匹配

I encountered the same issue. You can refer to my solution at https://github.com/open-compass/opencompass/issues/2027#issuecomment-3435966223