How can I change the scale for training?

[AlexzQQQ]

Thanks for the excellent work, I tried to change the default scale to others scale(e.g like 3 6 10),it can't work and the output is noise. and I wonder if it is ok to change the default scale without retrain for vqvae

[AlexzQQQ]

when i tried i change var.py class VAR's patch_nums, class VARHF's patch_nums,and arg_util.py pn

[JeyesHan]

It's OK to slightly change the scale schedule for vqvae since it adopts a CNN architecture. It could still encodes and decodes images normally but with a slight performance drop. However, VAR relys on the predefined scale schedule in the training stage. If you change the scale schedule without training VAR, it may generates noisy results. We suggest you fine-tune VAR if you change the scale schedule. The results will improves quickly.

[enjoyyi00]

@AlexzQQQ You can also train var with dynamic scale schedule, which means that you can random drop some scales, when testing, you can use dynamic scale schedule. However i strongly recommend you to fine-tune VAR if you change the scale schedule.

[AlexzQQQ]

@iFighting thanks a lot! I am working on retrain var for inpainting research, hope i can get a good result :)

[egbertYeah]

@AlexzQQQ how is the performance in inpainting?

[AlexzQQQ]

still trying    ------------------ Original ------------------ From: @.>; Date:  Wed, Dec 18, 2024 03:47 PM To: @.>; Cc:  "张昱辉Zhang @.>; @.>; Subject:  Re: [FoundationVision/VAR] How can I change the scale for training? (Issue #97)

 

@AlexzQQQ how is the performance in inpainting?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>