Ruben Hohndorf
Ruben Hohndorf
Specifying grammars in the Modelfile is one thing. It would be much more useful to be able to send a grammar string in the request, similar to llama.cpp server. Is...
That's really really cool. Though as far as i can see it's not merged into main yet.
It is extremely frustrating that the ollama core team is so silent about this topic. I am working on small llm local agents. I would love to use ollama but...
Seems fixed in nerfstudio-1.1.0: