Bennison J
Bennison J
> @arthurwolf You can try building using the following, it worked for me. > > `CUDACXX=/usr/local/cuda-12/bin/nvcc CMAKE_ARGS="-DLLAMA_CUBLAS=on -DCMAKE_CUDA_ARCHITECTURES=native" FORCE_CMAKE=1 pip install llama-cpp-python --no-cache-dir --force-reinstall --upgrade` Thanks, it worked
Is it available at Ollama now?
@SWHL, Thank you for the response! I have couple of follow-up questions based on your suggestions: 1. What would be the recommended target resolution for images to prevent memory overload...
@SWHL, Thanks for your update, I tried with the version 1.3.25, but it does not work for me. I am facing the same issue.
@SWHL, I believe this issue might be related to image dimensions. In my experience, the OOM killer was triggered when the image dimension width was in 1px width and 602px...
@SWHL, Any update on it?
@biraj-outspeed, I am having the same issue when using `uv pip install`. Can anyone help me build from source?
@biraj-outspeed, I tried it using the source, still having the same issue.
I am also facing the same issue, Any update on it?