Yuxiang Wang

https://blog.csdn.net/qq_41614419?spm=1011.2124.3001.5343

BUAA Beijing Personal CSDN Blog: https://blog.csdn.net/qq_41614419?spm=1011.2124.3001.5343 Research Area: Machine Learning, Reinforcement Learning, C++ dev ...

Results 2 comments of


                                            Yuxiang Wang

VIPosterior object can't save

Hi @manuelgloeckler Thanks, it works for me! Best wishes.

PPO使用zero3加载全参训练的奖励模型，奖励模型加载失败。

你们都是加载3个模型吗，actor, ref model, reward model，我这跑1.8b模型zero2都报错oom