SPIN icon indicating copy to clipboard operation
SPIN copied to clipboard
verified publisher icon uclaml

Question about the checkpoint provided in this repo

Open StarDewXXX opened this issue 1 year ago • 3 comments

Is the checkpoint provided in this repo trained with the old version of zephyr-7b-sft-full?

StarDewXXX avatar Mar 20 '24 04:03 StarDewXXX

if I want to reproduce the results reported in SPIN's paper, should I use revision=ac6e600eefcce74f5e8bae1035d4f66019e93190 and train with the SPIN dataset(iter 0,1,2,3) provided in huggingface?

StarDewXXX avatar Mar 29 '24 01:03 StarDewXXX

Yes, and we have updated the scripts and guidelines to reproduce the results in our paper. We specified the version by adding model_revision parameter in config.yaml. Please check our recent update and let us know if there are any remaining questions.

angelahzyuan avatar Apr 07 '24 06:04 angelahzyuan

if I want to reproduce the results reported in SPIN's paper, should I use revision=ac6e600eefcce74f5e8bae1035d4f66019e93190 and train with the SPIN dataset(iter 0,1,2,3) provided in huggingface?

https://github.com/uclaml/SPIN/blob/main/configs/config.yaml

angelahzyuan avatar Apr 07 '24 06:04 angelahzyuan