Crimsonfart
Crimsonfart
For those using the one click installer (Windows): Edit the following line in text-generation-webui/requirements.txt Old ``` llama-cpp-python==0.1.45; platform_system != "Windows" https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.45/llama_cpp_python-0.1.45-cp310-cp310-win_amd64.whl; platform_system == "Windows" ``` New ``` llama-cpp-python==0.1.50; platform_system !=...
> Will there need to be changes to the UI to access the new GPU acceleration of llama.cpp? I think this is only in the test phase and not yet...
I have exactly the same problem
This FIX worked for me! https://github.com/oobabooga/text-generation-webui/issues/912#issuecomment-1500961747
use vicuna v1.1
- use the latest gglm vicuna 1.1 model [https://huggingface.co/eachadea/ggml-vicuna-13b-1.1/resolve/main/ggml-vicuna-13b-1.1-q4_1.bin](url) - do a `git pull` in the text-generation-webui folder - double click on install.bat - edit start-webui.bat and add `--threads 10`...
Jep, i am looking for german voices.
> It doesn't work great, yet. maybe this model will help: https://huggingface.co/eachadea/ggml-toolpaca-13b-4bit includes the weights of Meta's open-source implementation of Toolformer (Language Models Can Teach Themselves to Use Tools by...
> This was the solution to my problem. > > [https://github.com/bmaltais/kohya_ss/issues/192#issuecomment-1435629534](url) Link is dead. Looks like someone is intentionally deleting all solutions on the topic. I my self also opened...
can someone explain to me what the difference between these two options is? (Both options work fine) - Option 1: main -i --interactive-first -r "### Human:" --temp 0 -c 2048...