Greg Diamos

Results 6 comments of Greg Diamos

crossplatform build procedure or prebuild wheel for armv7l arch

+1 helpful for M1 MacBooks

Quick Guide to Use it with Colab?

Good idea. We should put up a colab version...

Chinese support

Thanks for the request. Do you have a favorite base model that is good at Chinese, e.g. on huggingface?

Data quality

+1, @saharNooby . The base models being used here (pythia and dolly) have a long way to go. Getting this into a more usable state seems to require aggressive cleaning...

Data quality

> Also took a closer look at the `generate_data.py`code, and I'm curious what the basis of pairing up one question with a randomly sampled other question and training on it...

Data quality

> Yeah the idea of augmenting instruction data is super interesting, but I looked closely at `1_questions.jsonl` and some of the questions aren't questions. Instructions would definitely be a better...