palmex
palmex
I'm having a hard time recreating your results. I'm trying to retrain the VAE from scratch: LR 1e-4, Adam, 512 embedding size. The validation error seems to be leveling off,...
Did you ever run forward on the LM with just motion to motion or text to text or is this (below) the stage 1 of training as described in the...
It would be great if you could add more mobile oriented LLMs, such as https://github.com/facebookresearch/MobileLLM or provide instructions on how to add huggingface models