optimizer and scheduler

Open inconnu11 opened this issue 4 years ago • 1 comments

Hi, why do you update learning rate before optimizer.step() in code? Should not we conduct optimizer.step() fist and then conduct scheduler.step()? Or is there some other consideration?

Oct 12 '21 11:10 inconnu11

Hi, why do you update learning rate before optimizer.step() in code? Should not we conduct optimizer.step() fist and then conduct scheduler.step()? Or is there some other consideration?

Hi! Have you found an answer for your question?

Mar 03 '23 09:03 aidosRepoint