algorithmic-efficiency icon indicating copy to clipboard operation
algorithmic-efficiency copied to clipboard
verified publisher icon mlcommons

Add Lion baseline

Open tfaod opened this issue 6 months ago • 2 comments

  • Implementation: Google AutoML's Lion
  • Tunable hyperparameters: learning_rate, weight_decay, one_minus_beta1, beta2
  • Fixed hyperparameters: warmup_factor

tfaod avatar Aug 05 '25 19:08 tfaod