bigBatch
bigBatch copied to clipboard
eladhoffer
Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training of neural networks"
I've read your paper. But I don't understand the difference between GBN & BN used in framework. In my understanding, GBN does BN with local data. For distributed frameworks, they...
Hello, I'm having trouble reproducing the experiments from your paper using code from this repository. Let's focus on Table 1 from the paper, column +GBN and experiments C1, Resnet44, C3...
@eladhoffer What is the difference between `main_gbn.py` and `main_normal.py`? Thanks.
Metadata
Owner
Metadata
Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training of neural networks"