METACARBON

How to use the train.py finetuning the pre-trained MPT-7B?

1

It seems like we need to perform the pre-trainning process to get the checkpoint file before we can fine-tuning the MPT model. 1b_local_data_sft.yaml mentioned that we have to replace the...