Kyle Lyu

icon company Nanjing University of Aeronautics and Astronautics icon location Nanjing, China icon location Graduate student at NUAA

Results 1 comments of Kyle Lyu

AssertionError: no sync context manager is incompatible with gradientpartitioning logic of ZeRo stage 3

> +1, met this on deepspeed 0.16.1 with hf trainer The same problem with ZERO 3, HF trainer and deepspeed 0.16.1. Solved by downgrading to deepspeed 0.15.4.