FastChat
FastChat copied to clipboard
slurm clustering
Hello,
is it possible to implement model parallelism on the Slurm clustering system?
If so, could you provide some guidance on how to configure it?
If not, would it be possible for you to consider adding support for this technology to the clustering system?
I believe clustering is one of the important technologies for addressing GPU memory limitations.