DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard
verified publisher icon microsoft

Skip autoTP if tp_size is 1

Open molly-smith opened this issue 2 years ago • 0 comments

Skip auto TP if no tensor parallelism is needed / using only 1 GPU.

https://github.com/microsoft/DeepSpeed/issues/3285

molly-smith avatar May 04 '23 23:05 molly-smith