stable-diffusion icon indicating copy to clipboard operation
stable-diffusion copied to clipboard

img2img parallel threading

Open ulysses500 opened this issue 3 years ago • 0 comments

I am not able to use all the 20GB GPU memory to generate several images at the same time using img2img.

It seems to be due to the sync behavior of the DDIM sampler in the main step:

samples = sampler.decode(z_enc, c, t_enc, unconditional_guidance_scale=scale,unconditional_conditioning=uc,)

Do you have any suggestions on how to achieve this?

Note: this is not multi-processing as I would like to use one GPU from one graphic card.

ulysses500 avatar Jan 27 '23 12:01 ulysses500