supertrainer2000

supertrainer2000 copied to clipboard

Reame
Issues

Schedulers / optimizer wrappers

Open euclaise opened this issue 2 years ago • 0 comments

[ ] Elastic step decay
[ ] Explore-exploit/WSD (and triangular, as a subset of this)
[ ] Lookahead
[ ] Variational scheduler from RWKV
[ ] LAWA

Feb 15 '24 13:02 euclaise