VLMEvalKit icon indicating copy to clipboard operation
VLMEvalKit copied to clipboard

Audio modality evaluation

Open Simplesss opened this issue 1 year ago • 1 comments

Thank you very much for your open work. I would like to ask if the project will support audio modality evaluation, if so, is there a schedule, and what datasets and metrics will be supported?

Simplesss avatar Jul 25 '24 07:07 Simplesss

Hi, we currently do not include audio modality evaluation in the next several months. Meanwhile, our framework design is compatible with new modalities such as audio, and we warmly encourage community contributors to implement such features.

kennymckormick avatar Jul 27 '24 09:07 kennymckormick