BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

Encountering Size Mismatch Error in Updated Code

Open anonymousA123 opened this issue 1 year ago • 2 comments

While running the updated code, I encountered an issue as follows: 1

I would greatly appreciate any guidance or assistance you can provide to help resolve this issue.

anonymousA123 avatar Mar 13 '24 12:03 anonymousA123

it seems self.gamma and self.beta all need squeeze, i.e. self.gamma.squeeze()

2020zyc avatar Mar 13 '24 18:03 2020zyc

Thank you so much for your reply. May I ask if you have encountered the following error message?? Because when I add squeeze to self.gamma and self.beta, it reports an error: 1 Additionally, does training with the latest version of the code still generate gibberish messages like in issue #23?

AnonymousA12345 avatar Mar 17 '24 18:03 AnonymousA12345

Stale issue message

github-actions[bot] avatar May 19 '24 12:05 github-actions[bot]