vidore-benchmark icon indicating copy to clipboard operation
vidore-benchmark copied to clipboard
Published 7 months ago • verified publisher icon illuin-tech

TypeError: default_collate: batch must contain tensors... found <class 'NoneType'> when running MTEB with vidore/colqwen2.5-v0.2

Open ghazalkhalighinejad opened this issue 4 months ago • 2 comments

Running mteb run -b "ViDoRe(v2)" -m "vidore/colqwen2.5-v0.2" crashes with:

TypeError: default_collate: batch must contain tensors, numpy arrays, numbers, dicts or lists; found <class 'NoneType'>

ghazalkhalighinejad avatar Oct 22 '25 16:10 ghazalkhalighinejad

Hey @ghazalkhalighinejad , will look into that, just in order to have more infos, on what device are you running this code / what are your transformers/torch versions ?

QuentinJGMace avatar Oct 23 '25 12:10 QuentinJGMace

Hi @QuentinJGMace, thanks!

Device: NVIDIA A6000
Python: 3.12.8
Transformers: 4.53.3
Torch: 2.5.1+cu121

ghazalkhalighinejad avatar Oct 23 '25 15:10 ghazalkhalighinejad