Sultan
Sultan
I'd love to update and merge an OpenAI compatible serving script for these models if possible
Hey I just wanted to enquire on the License of this repo, is it MIT?
Some models do not generate a bos, so when trying to attribute a single token the code crashes. I added a `skip_bos` argument (that defaults to True to not change...
## Describe your feature request Hello, I just thought that having the ability to disable this feature would be nice considering a lot of people might have rate limits. ##...