Ryan Lynch

@proppy do you know if there is any timeline for putting together this example by chance? I am working on a pet project where this would be very helpful. Thanks!

Out of curiosity, what is holding up this PR (https://github.com/ollama/ollama/pull/4876) making it to main? It looks like its passing all the relevant PR tests. I think this would be a...

Thats a tough one. I would lean towards saying just let the user configure it since its so problem and hardware dependent. The ollama num_ctx default will probably not be...

Side note, tools like cline have tried to reformat their system prompt in "low context window" environments by strategically removing some features of their system prompt ensure the core functionality...

Hate to echo past comments, but doing it anyways because I think this feature is important for supporting older GPUs that don't support newer versions of Cuda, ROCm, or iPEX....

Hi all, 2 questions for ya: - With this push, would it still be possible to force iGPU use, even if using the CPU would be faster? Some people might...

> hi, I can add force enable intel iGPU by some env var in this PR, but can't promise it can work normal as ollama with Intel GPUs use llama.cpp-SYCL...