ControlLoRA icon indicating copy to clipboard operation
ControlLoRA copied to clipboard

Can controllora be used to learn to make templates for loras?

Open ca3gamedev opened this issue 2 years ago • 1 comments

Can controlloras be used to generate a template, of let's say a pose for a lora?

By example, can I train a controllora on rpg maker sprites, and eventually get something like a rpg maker lora that can sucesfully control a character and style loras to generate rpg maker sprites, sucesfully?

Or do controlloras have a diferent planned use. Many thanks.

ca3gamedev avatar Mar 03 '23 18:03 ca3gamedev

controllora actually does the controlnet doing. If you have pairs of spirit and pose, you could do the train. After train, you could try the mix. I give a simple usage of mix lora and controllora in mix_lora_and_control_lora.py. I would release a better example the next days.

HighCWu avatar Mar 03 '23 23:03 HighCWu