evolutionaryscale
ESM C load ESM 3 tokenizer？
Running into this too; wanted to try out 300M and I'm getting filtered by the ESM3 authorization list.
Same here - have access to the Forge API but don't know how to get onto the ESM3 authorization list on HF
Hi @wangleiofficial @matkozak @atarashansky , my group made a wrapper for this that has full Huggingface integration and batching. You don't need the ESM package, other weights, and the tokenizer comes ready to go :) https://huggingface.co/Synthyra/ESMplusplus_small
Hi @wangleiofficial @matkozak @atarashansky , my group made a wrapper for this that has full Huggingface integration and batching. You don't need the ESM package, other weights, and the tokenizer comes ready to go :) https://huggingface.co/Synthyra/ESMplusplus_small
Cool. I loaded it locally and successfully made sequence inference. Is it totally the same as using the esm package to load it?
Yep, there's tests of the GitHub that show they function the same. You can even load from the ESM package by using from_pretrained_esm instead of from_pretrained. Happy PLMing! 😁
Yep, there's tests of the GitHub that show they function the same. You can even load from the ESM package by using from_pretrained_esm instead of from_pretrained. Happy PLMing! 😁
Many thanks! I've given your project a star!
This should be reopened because this should be fixed in the ESM package anyway.