Udhav Sethi

Results 1 issues of Udhav Sethi

I am trying to run the finetuning script using 8 32GB V100 GPUs. I am using the torchrun command for using deepspeed with both parameter and optimizer offload, with a...