DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard
verified publisher icon microsoft

Has the default partition algorithm of pipline parallelism been changed? I found training speed becomed a little slower than previous versions

Open janelu9 opened this issue 2 years ago • 0 comments

deespeed==0.12.6 I do believe that the distribution of parameters is more reasonable, but why slower the training speed becomed?

janelu9 avatar Dec 28 '23 04:12 janelu9