umiswing comments

Repositories
Issues
Comments

Results 2 comments of


                                            umiswing

When will comm-gemm-overlap support multi nodes?

Thanks @denera . And I have another question: What's the pros of using TE's communication backend over nccl? Is it because Userbuffers provides a finer-grained option for comm operation (e.g....

When will comm-gemm-overlap support multi nodes?

Thanks @denera @yaox12 . And how does Userbuffers affect GEMM's performance? I know nccl can slow down GEMM when overlapping. And I also see options to set comm sm num...