ImportError: cannot import name 'DRESModel' from 'mteb'
python eval_C-MTEB.py --model_name_or_path ../../bge-large-zh-v1.5 --task_type DuRetrieval
Traceback (most recent call last):
File "/Users/Downloads/llm-models/FlagEmbedding/C_MTEB/eval_C-MTEB.py", line 4, in <module>
from flag_dres_model import FlagDRESModel
File "/Users/Downloads/llm-models/FlagEmbedding/C_MTEB/flag_dres_model.py", line 5, in <module>
from mteb import DRESModel
ImportError: cannot import name 'DRESModel' from 'mteb' (/Users/Downloads/llm-models/mteb/mteb/__init__.py)
Currently, the evaluation script needs a lower version of mteb. You needs to downgrade the version of mteb.
Currently, the evaluation script needs a lower version of mteb. You needs to downgrade the version of mteb.
Could you recommend a mteb version, thansk
Hi, @AlphaNext , I update the script. Now you can run it with latest mteb tool.
hi, i downloaded the latest script but still facing this problem : ImportError: cannot import name 'DRESModel' from 'mteb'
目前,评估脚本需要较低版本的 mteb。您需要降级 mteb 的版本。
你能推荐一个mteb版本吗,谢谢
实测1.1.0版本可用