Support Fine-tune on PeFT adaptation

Open Ejafa opened this issue 2 years ago • 1 comments

This project is great and the dataset is unique. To provide help to the community, it will be a great idea to support PeFT training on this dataset. Also, there's a chance to increase the training to RLHF if PEFT is supported (https://huggingface.co/CarperAI/vicuna-13b-fine-tuned-rlhf). We can compare the finetuned model with Vicuna as their dataset is also a synthetic dataset (ShareGPT)

Apr 26 '23 18:04 Ejafa

This project is great and the dataset is unique. To provide help to the community, it will be a great idea to support PeFT training on this dataset. Also, there's a chance to increase the training to RLHF if PEFT is supported (https://huggingface.co/CarperAI/vicuna-13b-fine-tuned-rlhf).

We can compare the finetuned model with Vicuna as their dataset is also a synthetic dataset (ShareGPT)

Thanks, it is a great suggestion. We are working on a full model and will then train peft modules.

Apr 27 '23 01:04 ningding97