VLMEvalKit icon indicating copy to clipboard operation
VLMEvalKit copied to clipboard
verified publisher icon open-compass

ChartQA augmented & CMMMU

Open KosumosuL opened this issue 2 years ago • 1 comments

It would be nice if VLMEvalKit can support evaluation on ChartQA augmented set and CMMMU, since it has supported ChartQA human set and MMMU

KosumosuL avatar Jan 25 '24 05:01 KosumosuL

Hi, @KosumosuL , ChartQA augmented is now incorporated. However, there is no news from the developers of CMMMU.

kennymckormick avatar Apr 15 '24 08:04 kennymckormick

VLMEvalkit has supported ChartQA.

junming-yang avatar Jul 19 '24 02:07 junming-yang