What are the stages to train LDM on custom dataset?

[taustudent]

Hello, thanks a lot for this great project! I'm little bit confused, what exactly I need to do in order to train class-condition LDM on my private dataset (~10k medical samples for school project)? I need to train AE followed by LDM? but how? what I need to configure? how to choose the AE type? should I train AE from the taming-transformer repo and use it here? and if I want to finetune some existing model, where I get trained model from and how I can train it?

please help me. thanks

[tangwy98]

Hello, thanks a lot for this great project! I'm little bit confused, what exactly I need to do in order to train class-condition LDM on my private dataset (~10k medical samples for school project)? I need to train AE followed by LDM? but how? what I need to configure? how to choose the AE type? should I train AE from the taming-transformer repo and use it here? and if I want to finetune some existing model, where I get trained model from and how I can train it?

please help me. thanks

Have you succeeded?

[Ma-Weijian]

Also looking for the training method!