imwide comments

Repositories
Issues
Comments

Results 4 comments of


                                            imwide

Code generation is not up to mark

Try rerunning the programm. It might get stuck on a behaviour it showed in previous messages.

How to use GPU?

Thank you mzen. when i run the command for installing it from source, i get an error. (btw i have cudatoolkit installed) ``` --- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test...

using nvcc --version this is the output: nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2021 NVIDIA Corporation Built on Thu_Nov_18_09:45:30_PST_2021 Cuda compilation tools, release 11.5, V11.5.119 Build...

How to use GPU?

@radames DONT just run `CMAKE_ARGS="-DLLAMA_CUBLAS=on" FORCE_CMAKE=1 pip install llama-cpp-python` But try `CMAKE_ARGS="-DLLAMA_CUBLAS=on" pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir` It worked for me with the same issue...