SSH-less connection on Kubernetes

[dogacancolak]

Is your feature request related to a problem? Please describe. What is the advised way to run DeepSpeed on Kubernetes? Starting an ssh daemon does not sound optimal, since we would need to have two processes per container: one for deepspeed and one for ssh.

Using MPI isn't a solution either since MPI also uses ssh to establish the connection.