CE0110

Constrained decoding with grammar fails for c4ai-command-r-v01

5

I am trying to apply constrained decoding for the recently adopted command-r. Using the most recent master branch (https://github.com/ggerganov/llama.cpp/commit/c47cf414efafb8f60596edc7edb5a2d68065e992) I'm trying to apply the simplest list. `./main -m ~/data/c4ai-command-r-v01/ggml-model-Q4_K_M.gguf -p...