Deep-Mutual-Learning icon indicating copy to clipboard operation
Deep-Mutual-Learning copied to clipboard
verified publisher icon chxy95

the kl loss become stable but getting larger

Open niliusha123 opened this issue 4 years ago • 1 comments

hi,

i have a problem when training recognition task, the kl loss become stable but getting larger , and other loss is getting lower, did you have this problem when training other tasks, and and how did this or what's the reason ?

thanks

niliusha123 avatar Sep 22 '21 03:09 niliusha123

@niliusha123 I didn't try this method on other tasks. Maybe you should adjust the coefficients of the different losses.

chxy95 avatar Sep 22 '21 14:09 chxy95