Michele Resta issues

Repositories
Issues
Comments

Results 1 issues of


                                            Michele Resta

flan_held_in task is broken starting with commit #1741

Hello! when launching the following `lm-eval --model hf --model_args pretrained=HuggingFaceTB/SmolLM-135M-Instruct --task flan_held_in --batch_size 32` the evaluation won't start. The problem start with commit 517aadc4d05507e2fea7b7753e91e6ad7dd76847. If I checkout to a previous...