[Request] Consider integrating the following list?

[sarapieri]

• VQAv2

• TallyQA: Answering Complex Counting Questions

• GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answering

• OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge

• A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge

[kennymckormick]

A-OKVQA has been supported now. We will add the rest ones into our TODO list.

[StanLei52]

any updates on these benchmarks?

I wondered if the following benchmarks are in the coming list:

1. MMVP Benchmark: https://huggingface.co/datasets/MMVP/MMVP
2. CV-Bench: https://huggingface.co/datasets/nyu-visionx/CV-Bench

[xushilin1]

A-OKVQA has been supported now. We will add the rest ones into our TODO list.

The A-OKVQA is not found in the latest version of the code.