CUDA OOM with 10 GPUs

[Faldict]

I have run run_exp.py with 10 GPUs, but it occurs out of memory errors:

RuntimeError: CUDA error: out of memory

As mentioned in your paper, you use only 5 GPUs for the experiments. So what's the problem?