LAMB missing in str2optimizer32bit?

Open Xynonners opened this issue 1 year ago • 0 comments

System Info

Python 3.11 venv, Arch Linux

Reproduction

import torch
import bitsandbytes as bnb

a = [torch.rand(1), torch.rand(1)]
opt = bnb.optim.LAMB8bit(a)
a[0].grad = torch.rand(1)
opt.step()

venv/lib/python3.11/site-packages/bitsandbytes/functional.py", line 1211, in optimizer_update_32bit optim_func = str2optimizer32bit[optimizer_name][0] ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^ KeyError: 'lamb'

Expected behavior

it steps the optimizer?

Mar 09 '24 21:03 Xynonners