oo0-0-0oo
Results
1
issues of
oo0-0-0oo
when I use DPO to train 7B starcoder, OOM happened, i used 16 A100 ,zero3 used TRL and transformers, When the code runs to `AutoModelForCausalLM.from_pretrained` , OOM happened. but qwencoder...