How can I use my custom trained controlnet with diffusers img-to-img pipeline?

Open Bilal143260 opened this issue 2 years ago • 3 comments

After I trained controlnet using the tutorial provided in the repository, I got the weights in .ckpt file. I wanted to use this controlnet in diffusers img-to-img pipeline which expects weights in .safetensors format and has different configuration file. How can I use my own trained controlnet with the img-to-img pipeline?

Dec 27 '23 06:12 Bilal143260

Use this script https://github.com/huggingface/diffusers/blob/main/scripts/convert_original_controlnet_to_diffusers.py

Dec 27 '23 14:12 kopyl

@kopyl thanks for the reply. It worked. Is there any similar script for converting base model on which controlnet is trained into diffusers format?

Dec 28 '23 10:12 Bilal143260

@Bilal143260 have no idea. Why do you need other scripts if it already worked?

Dec 28 '23 15:12 kopyl