krita-ai-diffusion icon indicating copy to clipboard operation
krita-ai-diffusion copied to clipboard

What are the excatly meaning for each Control Layer now?

Open pendave opened this issue 1 year ago • 1 comments

As the types of the Control Layer are increasing in the updating versions of krita-ai-diffusion, I'm a little confused when I use them.

Could you summarize it into a table? Purpose Group | Name | Description | Effect image | Example .kra file |

Such as Lines Control | Canny | ........................ Lines Control | Line Art | ........................ ........... Depth Control | Depth | ........................ ........... Refer Control | .................................

Now I'm very confused about: Referrence, Style, Composition, does Referrence equal to a visible image layer in the Layers stack? image

I hope in each release there's a table notion for these: image

And Could you please add a Sorting button to a better order for those messed up Control Layers accorting to their Purpose Group? image

pendave avatar Jun 20 '24 09:06 pendave

Reference/Style/Composition all use IP-Adapter. They act as a description like a text prompt, only using an image. You select for them a single layer with an image. Doesn't have to be visible, or the same size as your canvas. Preferrably it's square.

The rest are using ControlNet.

Yes documentation would be nice, but takes time, nobody has written any yet (since #315). Search for IP-Adapter or ControlNet you will find a lot of information and examples on the internet.

Regarding sorting: I don't typically recommend to use more than 2 or 3 of these, they cost performance and have diminishing returns.

Acly avatar Jun 21 '24 08:06 Acly

https://docs.interstice.cloud/control-layers/

Acly avatar Jan 23 '25 17:01 Acly