PReNet icon indicating copy to clipboard operation
PReNet copied to clipboard

关于递归监督

Open BubbleYu-ZJU opened this issue 5 years ago • 10 comments

请问,文章中提到的损失函数递归监督是怎么实现的呀?没有思路

BubbleYu-ZJU avatar Mar 28 '20 07:03 BubbleYu-ZJU

20200328152427

csdwren avatar Mar 28 '20 07:03 csdwren

@csdwren So λ = 0.5? What is pixel_loss?

FUNGERN avatar Mar 30 '20 11:03 FUNGERN

pixel_loss is ssim loss on the output of 6-th stage. out_train and outs[5] are same, the output of 6-th stage. So lambda_6=1.5 while all the other lambda=0.5

csdwren avatar Apr 01 '20 00:04 csdwren

@csdwren so λ1-5= 0.5 λ6 = 1.5 in ur paper,right? image

FUNGERN avatar Apr 01 '20 01:04 FUNGERN

yes

csdwren avatar Apr 01 '20 02:04 csdwren

yes

Thank you for your contribution, I have a new question, so the final use of this article is not lambda_ 6 = 1.5 while all the other lambda = 0.5.in the final loss?

FUNGERN avatar Jan 23 '21 03:01 FUNGERN

yes

Thank you for your contribution, I have a new question, so the final use of this article is not lambda_ 6 = 1.5 while all the other lambda = 0.5.in the final loss?

Yes. The final loss is only lambda_6 = 1

csdwren avatar Jan 23 '21 03:01 csdwren

yes

Thank you for your contribution, I have a new question, so the final use of this article is not lambda_ 6 = 1.5 while all the other lambda = 0.5.in the final loss?

Yes. The final loss is only lambda_6 = 1 Thank you for your reply. Why do you only take lambda_ 1-5 = 0.5? lambda_ What about experiments where 1-5 equals 0.2 or 0.8? We look forward to your reply.

FUNGERN avatar Jan 23 '21 03:01 FUNGERN

I did not try other settings, because I guess the final loss would ahieve best results.

Recursive loss makes the training more stable, while final loss may yield gradient vanish or explosion in few tries. Actually the results by final loss are better than recursive loss was surprising to me then.

csdwren avatar Jan 23 '21 03:01 csdwren

请问,文章中提到的损失函数递归监督是怎么实现的呀?没有思路 @BubbleYu-ZJU 请问您现在写好递归监督的脚本了吗?可不可以发一份给我感谢!我的邮箱[email protected]

zrt791521360 avatar Apr 09 '21 08:04 zrt791521360