Charles Srisuwananukorn

Conda takes too long to install dependencies

3

**Describe the bug** One user reported `conda env create -f environment.yml` taking over 60 minutes. We need a better solution. **To Reproduce** Steps to reproduce the behavior: 1. Run `conda...

Add print statements to `pretrained/GPT-NeoX-20B/prepare.py` to show progress

2

**Describe the bug** `pretrained/GPT-NeoX-20B/prepare.py` can take a long time to prepare the base model. It should print progress as it's converting. **To Reproduce** Steps to reproduce the behavior: 1. run...

Feedback from a user: When running the training script, it's not clear that it's making progress. The only way to know that it's doing something is by looking at nvidia-smi.

The bot commands for inference aren't very well documented. Add more documentation about what they do.

bot: use the huggingface auth token if specified

1

To better support private models, pass 'use_auth_token' to HuggingFace transformers if either the `OCK_USE_AUTH_TOKEN` environment variable is set or `--use-token` is passed at the command line.