Add command-r support like llamacpp has

Open rombodawg opened this issue 2 years ago • 5 comments

llamacpp has recently added command-r suppport. Can we get it for llamacpp-python?

https://github.com/ggerganov/llama.cpp/commit/12247f4c69a173b9482f68aaa174ec37fc909ccf

https://huggingface.co/CohereForAI/c4ai-command-r-v01

Mar 16 '24 03:03 rombodawg

Seconding this request. Command-R shows a lot of promise.

Mar 17 '24 20:03 Gaverfraxz

+1 pls

Mar 19 '24 05:03 azulika

Hey sorry for the late reply here, the model should work as of the version 0.2.57 pushed a couple of days ago.

One issue though is that the gguf files I saw on HF don't include the chat format.

Mar 20 '24 16:03 abetlen

I think this the description of chat format: https://docs.cohere.com/docs/prompting-command-r

Mar 21 '24 07:03 v2rockets

Related PR #1382

Apr 30 '24 07:04 jmtatsch