normatovjj

When I try to run `cmake -DGGML_CUBLAS=ON ..` I get: ``` CMake Warning at encodec.cpp/ggml/src/CMakeLists.txt:219 (message): cuBLAS not found ```

> When I try to run `cmake -DGGML_CUBLAS=ON ..` I get: > > ``` > CMake Warning at encodec.cpp/ggml/src/CMakeLists.txt:219 (message): > cuBLAS not found > ``` I also tried `CMAKE_ARGS='-DLLAMA_CUBLAS=on'...

That is interesting, I thought the app runs llama.cpp in the background to run the models, no? It seems that changing the -ngl to 99 does not change the performance,...