VLMEvalKit icon indicating copy to clipboard operation
VLMEvalKit copied to clipboard

支持LMDeploy作为推理后端

Open slchenchn opened this issue 2 years ago • 1 comments

您好,目前VLMEvalKit支持LMDeploy server作为judge,是否有计划支持LMDeploy server作为需要被评测的模型

slchenchn avatar Apr 28 '24 11:04 slchenchn

Hi, @slchenchn , Currently we have no plan to support lmdeploy served VLM. If you are interested, you can create a PR (including an API wrapper to call lmdeploy served VLM API), and we will help to review and merge.

kennymckormick avatar Apr 29 '24 03:04 kennymckormick