Mengfan Shi

Results 2 comments of Mengfan Shi

Yes, that's the problem. Adding it makes it normal. Thank you very much.

Thanks a lot for your suggestion ! I'll try to train a lora on all attentions layers.