Montassar Jaziri
Results
3
comments of
Montassar Jaziri
@Jeximo n_gpu_layers = -1 # The number of layers to put on the GPU. The rest will be on the CPU. If you don't know how many layers there are,...
Even when I try with 30 it still the same issue
yes still offloaded 0/33 layers to GPU :(  I used Llama cpp from langchain