PhdShi
PhdShi
not solved either
> Hi, have you solved this problem? hi, have you solved this problem?
```python -m torch.distributed.launch ddp.args_ main.py args``` you can get dataset from https://laion.ai/blog/laion-5b/
> which pytorch and torch-ccl version do you use? ngc images: nvcr.io/nvidia/pytorch:22.11-py3 pytorch version: 1.13.0a0+936e930 torch-ccl: 1.13
> it seems that your codebase is older than the 1.13.0 tag, and pytorch change the c10d distributed path in the [pytorch/pytorch#85780](https://github.com/pytorch/pytorch/pull/85780), so you may have 2 choices to fix...