tcluoct

I run 1.6 billion parameters demo, it cost 1:46:27 on first step and 2:12:56 on second step. it's much slower than below. Actor: OPT-1.3B Reward: OPT-350M | 2900 Sec |...