big_transfer icon indicating copy to clipboard operation
big_transfer copied to clipboard
verified publisher icon google-research

Linear warmup learning rate is 0 when step = 0

Open danielamassiceti opened this issue 4 years ago • 0 comments

Hi there

In the function get_lr() in bit_hyperrule.py, when step == 0, the returned learning rate is 0.0.

I wanted to check if this is a bug or intentional?

danielamassiceti avatar Jul 17 '21 11:07 danielamassiceti