Ask-Anything
Ask-Anything copied to clipboard
functions for MVBench eval in demo_mistral.ipynb
Hello,
I am currently studying lots of things on MVBench and was wondering why you provided functions for EgoSchema such as check_answer_egoschema() but not for MVBench? Since MVBench is the main benchmark you released, it would be very helpful to also have those functions for MVBench to reproduce the numbers from your paper. Do you have code for reproducing this as well?
Thank you! Best, Benno
I apologize for the late response. For information reproduce MVBench, you can check this notebook: MVBench Notebook.