Miguel Carvalho comments

Repositories
Issues
Comments

Results 2 comments of


                                            Miguel Carvalho

Deepspeed Hangs during Initialization

I'm still getting this issue and I can't even find the `torch_extensions` or the `py..._cu...` file or directory

new_grad_tensor.copy_(param.grad.view(-1)) AttributeError: 'NoneType' object has no attribute 'view'

Hello @eltonzheng . I am still facing this issue. This is the traceback I'm getting: ``` Traceback (most recent call last): File "/cfs/home/u021543/pheye_llavar_accelerate.py", line 68, in accelerator.backward(loss) File "/cfs/home/u021543/miniconda3/lib/python3.11/site-packages/accelerate/accelerator.py", line...