Mohamad Zamini

icon location USA icon location PhD Student NLP University of Wyoming

Results 4 comments of Mohamad Zamini

Update vae.py

> ``` > @microsoft-github-policy-service agree > ``` @microsoft-github-policy-service agree

Update trainer_utils.py

> @mzamini92 could you rebase so we can double check no tests are breaking with this and we can merge? Thanks! @muellerzr Thanks for reaching me. I did it based...

[Usage] Deepspeed Zero Stage 3 not able to shard the model

If I use 2 H100 I can run the code but I get OOM. When I increase it to +2 GPUs the model duplicates on GPUs instead of sharding and...

[BUG] CUDA error: no kernel image is available for execution on the device

same issue +1. OS: Linux GPU count and types: 8 x H100 80GB (if applicable) Hugging Face Transformers/Accelerate/etc. versions: [email protected] & 4.42 Python version: 3.10 deepspeed: 0.15.2 & 0.14.2 &...