AnimateDiff icon indicating copy to clipboard operation
AnimateDiff copied to clipboard

Asking for image layer in Unet training

Open dreamyou070 opened this issue 1 year ago • 1 comments

Hi, I want to follow training AnimateDiff. In the tutorial (https://github.com/guoyww/AnimateDiff/blob/main/assets/docs/animatediff.md) first I finetune with configs/training/v1/image_finetune.yaml config.

However in Paper, there is no unet finetuning process only Lora training for domain adoptation. Can you check is what is unet image layer finetuning means??

dreamyou070 avatar May 06 '24 14:05 dreamyou070

I have the same question. The paper says only a lora is needed for domain-adaptation, but in this project the whole unet is updated during the image_finetune stage

zoucheng1991 avatar Jun 03 '24 12:06 zoucheng1991