Dhruba Ghosh comments

Repositories
Issues
Comments

Results 2 comments of


                                            Dhruba Ghosh

Tried evaluate the model on a local network only machine

Hi, thanks for bringing this up! I assumed that the HF datasets would work properly without Internet connection because the `download_evalsets.py` script loads them once to put them in the...

Tried evaluate the model on a local network only machine

Can you try setting the environment variable `HF_DATASETS_OFFLINE` to `1`? (from https://huggingface.co/docs/datasets/v2.14.5/en/loading#offline) It seems like even if the dataset is cached, HF will by default check the online version. So...