diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

Multi-controlnet batching for `StableDiffusionXLControlNetInpaintPipeline`

Open kdubovikov opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe. Currently, batching is not supported when we are conditioning the SDXL pipeline on multiple controlnets: https://github.com/huggingface/diffusers/blob/28f9d84549c0b1d24ef00d69a4c723f3a11cffb6/src/diffusers/pipelines/controlnet/pipeline_controlnet_inpaint_sd_xl.py#L771

Describe the solution you'd like. We can pass a list of lists of images for batch inference.

Describe alternatives you've considered. One-by-one processing, which results in very low GPU utilization.

There was a similar PR raised for the StableDiffusionControlNetPipeline https://github.com/huggingface/diffusers/pull/6334

kdubovikov avatar Sep 24 '24 07:09 kdubovikov

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Oct 24 '24 15:10 github-actions[bot]

I would love to have this feature.

anjoeaj avatar Dec 12 '24 17:12 anjoeaj

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Jan 06 '25 15:01 github-actions[bot]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Jan 31 '25 15:01 github-actions[bot]