mumuchang

nccl problem when using lightseq for fairseq multi-gpus training

5

 There will be some problems when i use --user-dir=${LIGHTSEQ_DIR}/examples/training/fairseq/fs_modules to fairseq-train on multi gpus, but a single gpu will be fine. Environment cuda 10.1 pytorch 1.7.1 fairseq latest