diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

How to load lora trained with Stable Cascade?

Open zengjie617789 opened this issue 1 year ago • 3 comments

I finished a lora traning based on Stable Cascade with onetrainer, but I cannot find a solution to load the load in diffusers pipeline. Anyone who can help me will be appreciated.

zengjie617789 avatar Mar 12 '24 01:03 zengjie617789

Support not yet landed :) Stay tuned. Also, give us some more details:

  • The LoRA you are trying to load.
  • What steps you have already tried, etc.

sayakpaul avatar Mar 12 '24 03:03 sayakpaul

I used onetrainer to train lora model based on stable cascade.

  1. the lora model weight are constructed below like:

'lora_prior_te_text_model_encoder_layers_0_mlp_fc1.alpha', 'lora_prior_te_text_model_encoder_layers_0_mlp_fc1.lora_down.weight', 'lora_prior_te_text_model_encoder_layers_0_mlp_fc1.lora_up.weight', 'lora_prior_te_text_model_encoder_layers_0_mlp_fc2.alpha', 'lora_prior_te_text_model_encoder_layers_0_mlp_fc2.lora_down.weight',

  1. I did my best try to load lora offered by the officia onetrainer code in which use WuerstchenLoRAModelSampler to sample, and it is much different from the sd pipeline.

zengjie617789 avatar Mar 12 '24 06:03 zengjie617789

I did my best try to load lora offered by the officia onetrainer code in which use WuerstchenLoRAModelSampler to sample, and it is much different from the sd pipeline.

Do you have a link to the LoRA?

Also, let us know about the code you used from diffusers to load that LoRA.

sayakpaul avatar Mar 12 '24 06:03 sayakpaul

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

github-actions[bot] avatar Apr 11 '24 15:04 github-actions[bot]

Closing because of inactivity.

sayakpaul avatar Jun 29 '24 13:06 sayakpaul