Sean Peldom Zhang

icon company Westlake University icon location Hangzhou, Zhejiang, China icon location Official name: Yanzhe Zhang

Results 2 comments of Sean Peldom Zhang

losses went into inf/nan if optimizer is not SGD

Thank you sir, that was fast. Still the "**black hole**" bug exists(especially in the soft_iters, there is a sharp decline and then a sharp increase in losses), seems Evofomer learnt...

losses went into inf/nan if optimizer is not SGD

key codes: (adam, rmsprop, etc) ```py protocol == "binder" from jax.example_libraries.optimizers import rmsprop model._setup_optimizer(optimizer=rmsprop) model.design_3stage(soft_iters=40, temp_iters=40, hard_iters=20) ``` And the structure is predicted like this when all the losses are...