Answer vocabulary

Open gkv91 opened this issue 6 years ago • 3 comments

Hi, How the answer vocabulary is selected (for VQAv2, VQA-CPv2 and TDIUC)? Thanks

Dec 05 '19 11:12 gkv91

Most common answers. The number of answers is selected as an hyper parameter (grid search).

Dec 05 '19 15:12 Cadene

Do you mean top 1000,2000,3000 like that?. Also, the accuracy scores correspond to the questions with these answers (those are in the vocabulary) or the entire dataset? Thanks

Dec 05 '19 15:12 gkv91

Yes :'D

On the validation set, it's only on the chosen subset.

On the testing set, it's for all of them.

Dec 05 '19 16:12 Cadene