Alberto Espinilla
Alberto Espinilla
Hi! I'm working on it. I have a Tiktoken's port written swift but it's not ready. When i finish it i will publish it under my github's user account. This...
I have a proof of concept with some errors only on cl100k_base vocab and perform, i think I will be able to have a beta version on next week.
Hi @collinhundley ! I had published a very basic openai's tiktoken. You can check on this repository: https://github.com/aespinilla/Tiktoken Yes, it supports gpt-4 and more vocab 😉