Peter Hu

How can I train it on multi-GPU

13

I have tried change `OneDeviceStrategy` to be `MirroredStrategy`. https://github.com/google-research/seed_rl/blob/eff7aaa7ab5843547fbf383fcc747b7a8ca67632/common/utils.py#L58 But I get valueerror below. ``` Could not convert from `tf.VariableAggregation` VariableAggregation.NONE to`tf.distribute.ReduceOp` type Traceback (most recent call last): File "/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/framework/op_def_library.py",...