mPLUG icon indicating copy to clipboard operation
mPLUG copied to clipboard

Cannot reproduce VQA finetuning, please upload checkpoints

Open simon-ging opened this issue 2 years ago • 1 comments

Dear authors,

I finetuned mPLUG Base on VQAv2 but only get around 75% accuracy instead of the around 80% reported in the readme.

Could you kindly upload the finetuned checkpoints for VQA? I am benchmarking your model and would prefer to benchmark the strongest possible version.

Best,

simon-ging avatar Aug 27 '23 14:08 simon-ging

Dear authors,

I finetuned mPLUG Base on VQAv2 but only get around 75% accuracy instead of the around 80% reported in the readme.

Could you kindly upload the finetuned checkpoints for VQA? I am benchmarking your model and would prefer to benchmark the strongest possible version.

Best,

Hello, there is something wrong with my code. Can you help me look at it

erjpc avatar Jul 18 '24 07:07 erjpc