diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

add T5 lora train and infer for FluxPipeline

Open huangjun12 opened this issue 8 months ago • 1 comments

train and infer code of transformer lora + clip text encoder lora + T5 text encoder lora with FluxPipeline and FluxFillPipeline

huangjun12 avatar Jun 16 '25 08:06 huangjun12

Hi, is this a feature request?

AFAIK FluxFill can be finetuned the same as Flux so no need to separate both.

The training code is an example you can adapt to your needs, and maybe we will add it in the future but it's not a priority right now since most people won't have the hardware required for this, making it useful for only a few.

Also I suggest that if you want to do some more serious finetune with the text encoders, to use a specialized training library, sadly I don't know which one has support for training all the text encoders.

asomoza avatar Jun 20 '25 23:06 asomoza