hackey

Feature Request: Support Mistral-Large

1

### Prerequisites - [X] I am running the latest code. Mention the version if possible as well. - [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [X] I searched using keywords...

Please add the ability to use https://huggingface.co/mistralai/mamba-codestral-7B-v0.1 When running "benchmark_generation_mamba_simple.py" an error occurs: `"is the correct path to a directory containing all relevant files for a GPTNeoXTokenizerFast tokenizer."` I tried...

Support composable kernel on RDNA3 (7900 xtx)

12

Dear AMD developers! On behalf of thousands of ROCM users, I ask you to add support for RDNA3 and in particular 7900 xtx. We have been waiting for xformers support,...

[Feature]: Support Gemma3 GGUF

10

### 🚀 The feature, motivation and pitch Need support Gemma3 GGUF I also tried to try Gema 3 GGUF (https://huggingface.co/bartowski/google_gemma-3-27b-it-GGUF). An hour ago I downloaded the latest vllm code, built...