llama-api icon indicating copy to clipboard operation
llama-api copied to clipboard
verified publisher icon c0sogi

Stopped working after enabling CUDA

Open alexellis opened this issue 2 years ago • 0 comments

Hi, this was working really quite well on CPU for me, but I gave the tool access to the paths for libcublas, it compiled and now can't start or load due to my 3080 not having enough vRAM.

How do I completely force off CUDA so that I can use the tool again? I've tried taking the PATH and LD_ paths away, but the installer still seems to be building in CUDA mode.

Thanks

alexellis avatar Jan 12 '24 11:01 alexellis