curname

Support generate() like vllm, and run without docker?

1

Hi, thanks for your great work. Any plan to support generate() function like vllm or transformer? Without docker, user can also run generation code with python script. Like this： ```...

CUDA error 35

9

When i run ctransformers[cuda], i get the error: CUDA error 35 at /home/runner/work/ctransformers/ctransformers/models/ggml/ggml-cuda.cu:4236: CUDA driver version is insufficient for CUDA runtime version However, the path "/home/runner/work/ctransformers/ctransformers/models/ggml/ggml-cuda.cu" does not exit. And...

Any plan to support BigCode models?

1

Hi, thanks for your work. Do you have any plans to support the Bigcode models?