Dina Grechko comments

Repositories
Issues
Comments

Results 2 comments of


                                            Dina Grechko

[BUG] Failed for using cpu for pipeline based training across multiple machines (2 machines actually)

Hi! I faced with the same problem for pipeline parallelism for CPU-only case before release DeepSpeed v0.14.1 when communication backend gloo have been added as alternative for oneCCL. After upgrading...

Bug Report: Distributed Process Group Hangs with NCCL and GLOO Backends

Same issue