lighteval icon indicating copy to clipboard operation
lighteval copied to clipboard
verified publisher icon huggingface

Download BERT scorer lazily

Open sadra-barikbin opened this issue 1 year ago • 1 comments

Hi there!

  • ~~To import openai in llm_as_judge.py lazily.~~
  • To download BERT model in bert_scorer.py lazily.

sadra-barikbin avatar May 15 '24 11:05 sadra-barikbin

hi ! thanks for your PR, the lazy loading of openai has been implemented in #173. However, you can keep the lazy loading of BERT scorer.

NathanHB avatar May 16 '24 13:05 NathanHB