llama_cpp.rb icon indicating copy to clipboard operation
llama_cpp.rb copied to clipboard
verified publisher icon yoshoku

How to ensure CUDA is working?

Open coezbek opened this issue 2 years ago • 1 comments

I installed the gem using --cublas, but don't see any difference when running. Is there a way to know that cublas is being used?

coezbek avatar Sep 23 '23 13:09 coezbek

with_config requires adding with: gem install llama_cpp -- --with-cublas

yoshoku avatar Sep 25 '23 14:09 yoshoku