lighteval icon indicating copy to clipboard operation
lighteval copied to clipboard

Issue when saving results with fsspec==2023.12.1

Open Hamza-Alobeidli opened this issue 1 year ago • 0 comments

Dear lighteval team,

I had this version fsspec==2023.12.1, and I had issues once the evaluation is done is failing. I am using now fsspec==2024.3.1 and it works fine. Although I did pip install -e . before running the eval_accelerate. It would be grade if you add this to the setup requirements. Thanks

Hamza-Alobeidli avatar May 15 '24 14:05 Hamza-Alobeidli