Gao Yan

icon location I come from Hefei University of Technology and I have always loved open source projects

Results 13 comments of Gao Yan

Click outline jumps to document top

This problem occurs sometimes, not always 发件人：AbnerLee ***@***.***> 发送日期：2024-01-23 12:26:14 收件人：typora/typora-issues ***@***.***> 抄送人：Gao Yan ***@***.***>,Author ***@***.***> 主题：Re: [typora/typora-issues] Click outline jumps to document top (Issue #5948) Possible to send us...

Why does the loss suddenly drop to zero and the grad_norm stabilize at 1 at specific training steps when fine-tuning Llama3.2-vision-11B?

请问后来是怎么解决的呢

[BUG]clip gradient not working

> > Ok, after some investigation I found out that, at least in my case, gradient clipping is happening, but transformers trainer is logging the wrong thing. > > In...