FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

ImportError: cannot import name 'DRESModel' from 'mteb'

Open AlphaNext opened this issue 1 year ago • 5 comments

python eval_C-MTEB.py --model_name_or_path ../../bge-large-zh-v1.5 --task_type DuRetrieval

Traceback (most recent call last):
  File "/Users/Downloads/llm-models/FlagEmbedding/C_MTEB/eval_C-MTEB.py", line 4, in <module>
    from flag_dres_model import FlagDRESModel
  File "/Users/Downloads/llm-models/FlagEmbedding/C_MTEB/flag_dres_model.py", line 5, in <module>
    from mteb import DRESModel
ImportError: cannot import name 'DRESModel' from 'mteb' (/Users/Downloads/llm-models/mteb/mteb/__init__.py)

AlphaNext avatar Mar 11 '24 08:03 AlphaNext

Currently, the evaluation script needs a lower version of mteb. You needs to downgrade the version of mteb.

staoxiao avatar Mar 11 '24 09:03 staoxiao

Currently, the evaluation script needs a lower version of mteb. You needs to downgrade the version of mteb.

Could you recommend a mteb version, thansk

AlphaNext avatar Mar 12 '24 02:03 AlphaNext

Hi, @AlphaNext , I update the script. Now you can run it with latest mteb tool.

staoxiao avatar Mar 12 '24 08:03 staoxiao

hi, i downloaded the latest script but still facing this problem : ImportError: cannot import name 'DRESModel' from 'mteb' 微信图片_20240329000142

WANGDAKEKE avatar Mar 28 '24 16:03 WANGDAKEKE

目前,评估脚本需要较低版本的 mteb。您需要降级 mteb 的版本。

你能推荐一个mteb版本吗,谢谢

实测1.1.0版本可用

bringfull avatar Apr 10 '24 06:04 bringfull