Bennison J

Results 10 comments of Bennison J

> @arthurwolf You can try building using the following, it worked for me. > > `CUDACXX=/usr/local/cuda-12/bin/nvcc CMAKE_ARGS="-DLLAMA_CUBLAS=on -DCMAKE_CUDA_ARCHITECTURES=native" FORCE_CMAKE=1 pip install llama-cpp-python --no-cache-dir --force-reinstall --upgrade` Thanks, it worked

@SWHL, Thank you for the response! I have couple of follow-up questions based on your suggestions: 1. What would be the recommended target resolution for images to prevent memory overload...

@SWHL, Thanks for your update, I tried with the version 1.3.25, but it does not work for me. I am facing the same issue.

@SWHL, I believe this issue might be related to image dimensions. In my experience, the OOM killer was triggered when the image dimension width was in 1px width and 602px...

@biraj-outspeed, I am having the same issue when using `uv pip install`. Can anyone help me build from source?

@biraj-outspeed, I tried it using the source, still having the same issue.

I am also facing the same issue, Any update on it?