tomerip

**Describe the bug** Using DeepSpeed Inference (using `deepspeed.init_inference`) gives weird outputs when using batch size > 1 and padding the inputs. I'll first state the problem with more detail and...