Luna_yyq

icon indicating an email [email protected]

icon company The University of Texas at Austin icon location Austin, TX icon location PhD_student@UT-Austin

Results 1 comments of Luna_yyq

Significant Performance Drop in GSM8k Evaluation with Updated SFT ckpt

I use lm-evaluation-harness v0.4.0 for evaluation, which is consistent with the evaluation version used by the author. In addition, the results displayed above are obtained using num_train_epochs=6 for training.