SharpToken
SharpToken copied to clipboard
o200k_base support
It would be great to add gpt-4o o200k_base encoding support
I added a PR that might accomplish this, here: https://github.com/dmitry-brazhenko/SharpToken/pull/41