Alex
Results
1
comments of
Alex
I ended up swapping deeply even for bookcorpus-wikipedia. Used 128Gb RAM + 46Gb in swap with 16 core CPU. Used this command `python pretrain.py data=bookcorpus-wikipedia dryrun=True` `Overall, I used to...