Jeffrey Wang

icon indicating a website link https://jeffreygwang.com

icon company @harvard icon location jack kerouac enthusiast. harvard 25!

Results 1 comments of Jeffrey Wang

[Pythia on Pile-Dedup] Training for ~1.5 epochs: how to identify the repeated sequences (i.e., the additional .5 epoch)?

Hey! I had similar questions a while back for a paper in which we used the Pythia suite—to the best of my understanding, the answers are that it's 1.5 epochs,...