Chris Tyler issues

Repositories
Issues
Comments

Results 1 issues of


                                            Chris Tyler

[BUG] Huggingface and Neuron runs fail if model revision is an integer

When the model revision identifier only consists of integers the run will fail because the revision is naively appended to a string [here](https://github.com/EleutherAI/lm-evaluation-harness/blob/7f15cce4d759043428b3db14970677fcec6e7a45/lm_eval/models/huggingface.py#L194) in the HF model and [here](https://github.com/EleutherAI/lm-evaluation-harness/blob/7f15cce4d759043428b3db14970677fcec6e7a45/lm_eval/models/neuron_optimum.py#L235) in...