x666633
x666633
Hi Reedwm: How do you do? We meet some troubles.Can you help and give us some suggestions? Thanks a lot  How could I implement benchmark mode to SyncReplicasOptimizer;
@mingxingtan Thanks for your reply! The SyncReplicasOptimizer use **data_flow_ops.ConditionalAccumulator_** to average grads from all workers like this:  The **get_gradients_to_apply** how to achieve average grads from all workers