umchand

Results 2 comments of


                                            umchand

[BUG]DeepSpeed zero3 use more gpu memory than zero2

@TheDecisionJTree Can you share your exact deepspeed config or the ds_pretrain ....sh script ?

[BUG in Stable Diffusion inference] There's an error on CUDAGraph when using deepspeed inference. How to fix it?

Can you try upgrading the torch to 2.2.1 and use the latest deepspeed ?