QJSQJS comments

Repositories
Issues
Comments

Results 2 comments of


                                            QJSQJS

Loss becomes nan after few batches

Hello, I also met the problem+1, :( . Have you solved this problem?

Loss becomes nan after few batches

I found a solution! When the batch decreases, the lr should decrease. The following are my parameters: _batch = 8; subdivisions = 4; lr = 0.0001;_ It works fine!