pytorch-optimizer icon indicating copy to clipboard operation
pytorch-optimizer copied to clipboard

`AttributeError: module 'torch_optimizer' has no attribute 'MAGRAD'`

Open SamMohel opened this issue 2 years ago • 1 comments

I tired to follow the example of using MAGRAD optimizer

  import torch_optimizer as optim
   optimizer = optim.MAGRAD(model.parameters(), lr=0.1)
   optimizer.zero_grad()
   loss_fn(model(input), target).backward()
   optimizer.step()

but got AttributeError: module 'torch_optimizer' has no attribute 'MAGRAD'

SamMohel avatar Dec 18 '23 05:12 SamMohel

It's an typo mystake bro,it actually a MADGRAD Optimizer.

try using MADGRAD instead of MAGRAD

Jayavardhan-7 avatar Oct 08 '24 07:10 Jayavardhan-7