WarAnakin

Depending on the optimizer and scheduler you use, you can achieve faster/better results.

> > Depending on the optimizer and scheduler you use, you can achieve faster/better results. > > do you have any suggestions? i just saw your reply, sorry for the...

> @WarAnakin polynomial scheduler sounds really promising. We you willing to share the related code in PR or in your forked repository, please? yes, i'll do that now, you only...

> @WarAnakin polynomial scheduler sounds really promising. We you willing to share the related code in PR or in your forked repository, please? This one's for you: https://github.com/WarAnakin/ai-toolkit/blob/main/toolkit/scheduler.py You don't...

@D-Ogi please don't forget to add the following line of code to the config file 

> > Thank you both. I tested the `polynomial` scheduler rather deeply but it seems to be very weak even with 1e-2. I went from 1e-5 to 1e-1 and steps...

> @WarAnakin I tried using your configuration and did get better results. However, when I restore the fine-tuned checkpoint, my images don’t look the same as they did with the...

i'm currently making changes to the scripts on my end to run mult-gpus. I have quite a bit of requests and 1 gpu doesn't cut it. I know that the...

> One way I see to train on multiple GPUs at once is to create several .yaml files, each with a different GPU and a different part of the dataset....

> Hello, is there a way to use multiple GPUs in the ai-toolkit config ? I'm trying to train with 2 x T4 GPU on Kaggle. thank you not yet