diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

[PAG] add `StableDiffusionXLControlNetPAGImg2ImgPipeline`

Open yiyixuxu opened this issue 1 year ago • 6 comments

We recently integrated PAG into diffusers! See the PR here: https://github.com/huggingface/diffusers/pull/7944

Does anyone want to add a StableDiffusionXLControlNetPAGImg2ImgPipeline?

  1. You should put it under the pag folder
  2. you can use the implementation of StableDiffusionXLControlNetPAGPipeline and StableDiffusionXLPAGImg2ImgPipeline as reference
  3. you need to add AutoPipeline so that you can use this API to create it
       AutoPipelineForImage2Image.from_pretrained(repo_id, controlnet=controlnet, enable_pag=True ...)
    
  4. tests and docs

yiyixuxu avatar Jun 25 '24 18:06 yiyixuxu

hi @yiyixuxu, i'll contribute it can you assign me?

satani99 avatar Jun 25 '24 19:06 satani99

@satani99 yes!

yiyixuxu avatar Jun 25 '24 19:06 yiyixuxu

can i work on this

tuanh123789 avatar Jun 26 '24 02:06 tuanh123789

@tuanh123789 this one is already taken :) I opened a new issue here https://github.com/huggingface/diffusers/issues/8710 leave a comment there if you are interested

yiyixuxu avatar Jun 26 '24 08:06 yiyixuxu

Hi @satani99, I kind of need StableDiffusionXLControlNetPAGImg2ImgPipeline, are you still working on this? If you're having trouble with it you can just open the PR with what you have and we will help you.

asomoza avatar Jul 02 '24 23:07 asomoza

I'll open a PR today.

satani99 avatar Jul 03 '24 01:07 satani99