cancelself
cancelself
Forked + fixed for our app. If I get the time, will make it a property and send a PR. https://github.com/dpurdy/TwitchPlayer
> Hey [@Jimmy-Newtron](https://github.com/Jimmy-Newtron) will add support for it next week. In the meantime can you please send out the full error message with the conversational instance id? Thanks! Hit the...
> I can't fit this model with 128K as well, something is not playing nice here. (tested the vLLM with 128K, no problem) next stop, vllm!