Optimizer states in HF format

[seyuboglu]

Hi folks -- thanks for the great work on this.

I've been doing some fine-tuning experiments off the huggingface checkpoints and was wondering whether anyone has converted the neox optimizer states to HF format/has a script for doing so.

Thanks!!

[haileyschoelkopf]

I don't know of any such preexisting conversion script unfortunately -- but if you have questions in creating those or about the checkpoint format lmk!