lighteval icon indicating copy to clipboard operation
lighteval copied to clipboard
verified publisher icon huggingface

Nanotron tests

Open zzhhjjj opened this issue 1 year ago • 5 comments

Tests for Nanotron can be conducted in both full and lite modes. Tasks can be defined by modifying the configuration file

zzhhjjj avatar Apr 19 '24 08:04 zzhhjjj

Hi @zzhhjjj ! Thanks a lot for the PR! You'll need to pull (I merged main in your branch to update it) and run our pre-commit hook to make sure the code style is correct. I'll take a look asap :)

clefourrier avatar Apr 19 '24 08:04 clefourrier

Tests are failing because you also need to add nanotron installation for our test suite :) You need to add nanotron after dev, at this line

clefourrier avatar Apr 19 '24 09:04 clefourrier

Please wait a little bit to execute tests, I still need to change the nanotron code. Already made a PR to nanotron

zzhhjjj avatar Apr 19 '24 11:04 zzhhjjj

No problem! Ping me when it's good

clefourrier avatar Apr 19 '24 11:04 clefourrier

Hi @zzhhjjj !

Do you know where you are relative to this PR? :)

clefourrier avatar May 22 '24 07:05 clefourrier

cc @NouamaneTazi :) I can close this one if you want to start from scratch?

clefourrier avatar Nov 27 '24 18:11 clefourrier