KungFu

KungFu copied to clipboard

A question about Horovod central coordinator in the paper of KungFu

2

**The asynchronous collective communication layer also avoids having an expensive central coordinator, as used for invoking synchronous collective communication operations inexisting systems, such as Horovod.** I see the paper of...

JohanOu

lgarithm

Hello! I am looking for training distribution framework and did you try it on windows? Because I am facing linking issue with tensorflow (possibly MinGW and MSVC linking conflicts)

blacksailer

lgarithm

lgarithm

In the paper based on this project it is mentioned: "We implement an AP that adapts the batch size based on GNS when training the ResNet-56 model with the CIFAR-10...

aleksficek

luomai

luomai