Athanasios N. Nikolakopoulos

icon indicating a website link www.nikolako.net

icon company Amazon.com icon location Seattle icon location Computer Scientist ML/AI Researcher and Engineer

Results 1 comments of Athanasios N. Nikolakopoulos

RuntimeError: 'weight' must be 2-D while training Flan-T5 models with stage 3

I had the same issue. Thankfully, it went away when I upgraded to Deepspeed 0.9.5.