LoggerHead22

[BUG] Problems with MiCS training

4

**Describe the bug** Hi, i'm trying to run pretraining gpt model with [Megatron-DeepSpeed](https://github.com/microsoft/Megatron-DeepSpeed?ysclid=ls8rr5jnv3799144357) pipeline and Zero-3 + Mics sharding strategy, but got next log: ``` WARNING: Runtime Error while waiting...