Loss value equals to NAN!

Open revaeb opened this issue 4 years ago • 1 comments

Thx for your marvelous work! I am trying to use your method as my baseline, but I find that if I set the epoch larger than 300(which is set in your script originally), after the 200 epoch, the loss value will be NAN. I cannt figure it out what's wrong, do you have any idea about that? Thx!

Dec 09 '21 13:12 revaeb

Hi, thanks for your attention. This sounds strange. I tried larger epochs (like 600 or 1200) before. Can you check the learning rate after 200 epochs?

Dec 21 '21 19:12 ZHKKKe