FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

slurm clustering

Open DTDwind opened this issue 2 years ago • 0 comments

Hello,

is it possible to implement model parallelism on the Slurm clustering system?

If so, could you provide some guidance on how to configure it?

If not, would it be possible for you to consider adding support for this technology to the clustering system?

I believe clustering is one of the important technologies for addressing GPU memory limitations.

DTDwind avatar Apr 04 '23 02:04 DTDwind