latent-diffusion icon indicating copy to clipboard operation
latent-diffusion copied to clipboard

create similar images from a real image.

Open loboere opened this issue 3 years ago • 3 comments

Is there a way for this to create similar images of a real image like dall-e 2 does?

loboere avatar Apr 17 '22 00:04 loboere

@loboere If you mean prompt using part of real image to create similar image, you can try my PR, which does inpainting such as generate a cat wearing a green hat with a real cat image

If you mean priming on a whole image, not a masked region, and generate similar result but not exact, you may need to do some coding, to manually craft a x_T=x_T to DDIM sampler, see my PR for reference (but I didn't code x_T), The way I give x0 to DDMS should work on x_T too... probably

images_inpainting

The complete code in my PR: https://github.com/CompVis/latent-diffusion/pull/57

lxj616 avatar Apr 19 '22 13:04 lxj616

I would really love this feature too! I mean priming on a whole image, not a masked image (however that would be interesting too).

@lxj616 @loboere do you have any plans for implementing it? (I cannot be of great help in that regard, sorry.)

illtellyoulater avatar Apr 22 '22 23:04 illtellyoulater

for now implement the function of using a part of a real image you can try it in the colab that is in my repository

https://github.com/loboere/latent-diffusion-inpainting-colab

loboere avatar Apr 23 '22 04:04 loboere