Pablo Rodriguez Mira

Results 3 issues of Pablo Rodriguez Mira

The OpenAI compatibility module does not allow for setting the number of tokens window (num_ctx) via API call dynamically instead of having to adjust the Modelfile each time we want...

feature request