Minghao (Alan) Xu

icon indicating a website link https://chrisallenming.github.io/ icon indicating an email [email protected]

icon company PKU & Mila icon location Shanghai, China icon location I'm a PhD student at Peking University & Mila - Quebec AI Institute

Results 3 comments of Minghao (Alan) Xu

EnzymeCommissions always NaN using ESM fixed

Hi, I have checked the ESM on EC config in the GearNet repo. Everything looks fine to me. The most important points are `lr_ratio: 0.1` and `max_length=550` for reproducing the...

EnzymeCommissions always NaN using ESM fixed

Yeah, it's weird. I'm afraid I cannot tell why it is the case. BTW, for ESM on EC, I think `batch_size: 16` may easily exceed the maximum GPU memory. I...

EnzymeCommissions always NaN using ESM fixed

Oh, I just find you fix the encoder, so you can have the batch size of 16. The truncation length and other configurations also look fine to me