DeepSpeed
DeepSpeed copied to clipboard
Auto TP Tutorial with T5 Example
Updates Auto Tensor Parallelism tutorial with T5 example instead of OPT, since OPT is supported with kernel injection and we would like to showcase a model that does not have kernel injection as an option. However, still includes OPT for long sequence testing.