About rescaling residual connection?

Open BIGJUN777 opened this issue 3 years ago • 1 comments

Hi, there. In the paper, you described rescaling residual connections, while I did not find this in the current code. Did I miss something?

Jun 15 '22 10:06 BIGJUN777

Hi, there. In the paper, you described rescaling residual connections, while I did not find this in the current code. Did I miss something?

I did not find either. Actually, this paper is quite difficult to read as the authors are not intend to let you understand some operation at first.

Jan 04 '24 06:01 LZX-ZNRA