SparseR-CNN icon indicating copy to clipboard operation
SparseR-CNN copied to clipboard
verified publisher icon PeizeSun

issues about Mix-Precision training

Open hammer422 opened this issue 4 years ago • 1 comments

Thanks for your great work!! Because of the limitation of GPU, I used pytorch native amp for training. However, I found some problems with numerical stability while computing giou, NaN or inf. Is there any good suggestion to solve this problem

hammer422 avatar Mar 01 '21 08:03 hammer422

Hi~ Does reducing learning rate help?

PeizeSun avatar Mar 03 '21 03:03 PeizeSun