Yuxuan Wei

Multi-gpu slower than single-gpu

1

Hi, I found that with same hyper-parameters but different `num_core_per_host` (`num_core_per_host=1` for single-gpu and `num_core_per_host=6` for multi-gpu), `global_step/sec` of multi-gpu is slightly fewer than that of single-gpu. **num_core_per_host=6:** ``` INFO:tensorflow:global_step/sec:...