DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Auto TP Tutorial with T5 Example

Open molly-smith opened this issue 2 years ago • 0 comments

Updates Auto Tensor Parallelism tutorial with T5 example instead of OPT, since OPT is supported with kernel injection and we would like to showcase a model that does not have kernel injection as an option. However, still includes OPT for long sequence testing.

molly-smith avatar Mar 07 '23 18:03 molly-smith