RedPajama-Data icon indicating copy to clipboard operation
RedPajama-Data copied to clipboard

Guide how to use

Open kamalkech opened this issue 3 years ago • 1 comments

Can you share link of guide how to use this model ??

kamalkech avatar Apr 17 '23 22:04 kamalkech

It is not a model, it is a group of Python files you can run to create a dataset in the format needed to train an LLM such as LLaMA. None of the code has to do with actually training a model, which you would do with something like GPT-NeoX-20B.

ericborgos avatar Apr 18 '23 10:04 ericborgos

Yes, this repo allows you to create the dataset used to train LLaMA like models.

mauriceweber avatar Apr 21 '23 12:04 mauriceweber