yates sun

> > When I use Distribution in imagenet with one Node, there is three print at the same time. > > Just like this. > >  > > Is...

Thanks for your help .Firstly,I am using two gpus. Secondly,I add a try-catch in the forward method of the _SynchronizedBatchNorm class(batchnorm.py).Then ,I locate the error step by step. ### 1....

### The detailed information Traceback (most recent call last): File "/mnt/data-2/data/cnn_multi_/cnn_multi/sync_batchnorm/batchnorm.py", line 68, in forward mean, inv_std = self._sync_master.run_master(_ChildMessage(input_sum, input_ssum, sum_size)) File "/mnt/data-2/data/cnn_multi_/cnn_multi/sync_batchnorm/comm.py", line 125, in run_master results = self._master_callback(intermediates)...