llama-cpp-python icon indicating copy to clipboard operation
llama-cpp-python copied to clipboard
verified publisher icon abetlen

Add support for Cohere Command models

Open handshape opened this issue 8 months ago • 1 comments

Hi there -- Cohere's Command models use break in their jinja templates. Adding the jinja2.ext.loopcontrols extesion to the jinja environment is sufficient to enable support.

handshape avatar May 12 '25 21:05 handshape

Now that devstral has dropped, and has even wackier stuff in their jinja templates, I wonder if there's a general form of this issue. Would it make sense to expose the jinja context, and let the consumer of the library decide what features and context objects they want to enable in jinja?

handshape avatar May 23 '25 02:05 handshape