Thomas M

Your GPU is probably not used at all, which would explain the slow speed in answering.

1

Please help me to configure BLAS=1, on RTX 3070, WIN 11. I have llama-cpp-python==0.2.23 --no-cache-dir Thank you so much ························· Your GPU is probably not used at all, which would...