krita-ai-diffusion icon indicating copy to clipboard operation
krita-ai-diffusion copied to clipboard

Do you have any plan of integrate the ControlNet LLLite?

Open 5hal1n opened this issue 2 years ago • 3 comments

Your plugins have always helped me. Thank you very much.

Official SD XL ControlNet doesn't include good scribble model. But kohya's ControlNet LLLite Scribble model is seems good. https://github.com/kohya-ss/ControlNet-LLLite-ComfyUI

So I want to know do you have any plan. If yes, I want to know when, or I want to try contribute. If not, I want to know reason.

5hal1n avatar Jan 11 '24 07:01 5hal1n

No concrete plans, the main reason I haven't used them over the others is that they require an extra custom node package. That's not a show-stopper though, if you can demonstrate the scribble works better than using current one it would be worth replacing it. I agree current solution for SDXL scribble isn't great, but comparison of a few scenarios would still be nice. For the current one you probably want a lower strength (around 50%).

Acly avatar Jan 11 '24 16:01 Acly

Thank you. I tried with lower strength but it's not good, so I'll try LLLite in ComfyUI and upload the result.

5hal1n avatar Jan 12 '24 09:01 5hal1n

Somewhat similar discussion in #316, though the OP never mentioned what models they had in mind.

Acly avatar Jan 12 '24 10:01 Acly