Bissmella Bahaduri
Bissmella Bahaduri
Yep, ready for review! I tested it with a 4-process setup (2×2 mesh, on cpu) and everything checks out, shapes look good and gradients flow correctly. Looking forward for feedback...
> I am trying with the following code: > > ```python > import torch > from torch import distributed as dist > from diffusers import AutoModel, DiffusionPipeline, ContextParallelConfig > >...
> > I am trying with the following code: > > ```python > > import torch > > from torch import distributed as dist > > from diffusers import AutoModel,...
I think that is perfect, I didn't know specific about torch 2.9. I will apply the diff. Thanks a lot for sharing your script and those amazing photos. Should I...
Okay I will add the docs and then remove the test file.
Oups! so sorry for the force push. Just resolved a conflict in the distributed_inference.md in docs. I added the docs and removed the test file.
Yes sure, I can do the benchmarking for the three methods.