Loading tokenizer trained with Huggingface implementation

[mazzma12]

Hey, I you mentioned this implementation was heavily inspired by the Huggingface one. I was wondering if it's possible to load a tokenizer trained with huggingface with this implementation ? If it is, is there any gotchas to be aware of ? I thought this information was lacking from the doc. Thank you