gformcreation

CUDA 12.1 Llama-cpp-python version 0.2.84 pre-built request.

4

Hi, I was working on a recent project using this framework and encountered issues while installing and building it locally. Fortunately, I discovered the prebuilt option provided by the repo,...

First, thank you for your incredible work on this project! To enhance its performance, especially on mobile devices and NPU-enabled PCs like those with Copilot+, I would love to see...

NPU Support ?

2

Hi Guys, Wanted to ask does this supports proper NPU ? for llm loading and processing?

Support for phi 4 mini

3

Hi Team, Thanks for the project, Can you please help in upgrading the version with latest llama cpp ? Ref https://github.com/ggml-org/llama.cpp/issues/12091