iChristGit
iChristGit
### Is there an existing issue for this? - [X] I have searched the existing issues and checked the recent builds/commits ### What happened? Ive seen that it mentioned in...
### Is there an existing issue for this? - [X] I have searched the existing issues and checked the recent builds/commits ### What happened? Im on latest version, trying to...
I had a working LLamma 7b installation, but 13b failed with 24gb vram (3090ti) and 32gb ram, so I tried this: https://github.com/oobabooga/text-generation-webui/issues/147#issuecomment-1456040134 (downloaded the dll and put it in the...
Loading llama-7b... Traceback (most recent call last): File "D:\MachineLearning\TextWebui\text-generation-webui\server.py", line 194, in shared.model, shared.tokenizer = load_model(shared.model_name) File "D:\MachineLearning\TextWebui\text-generation-webui\modules\models.py", line 94, in load_model from llama import load_quant ModuleNotFoundError: No module named...
I have a 3090 and 32gb vram, using Windows 11 and Ubuntu Virtual machine (WSL) With the Windows 11 install I get maybe 3 words per second at best (7B)...
Is there a way to add more presets to the webui? Or maybe have a easy way to dl them like the model downloader that is provided?
### Describe the bug I am using WSL Had to install all the requirements manually using pip (because It didnt install it automatically, nor the other extensions) after installing I...
### Describe the bug I am setting up Webui with WSL, followed all the steps, running normally or 8-bit doesnt work, 4bit does. I dont know how to fix that....
### Describe the bug I enabled --xformers, and did a pip install xformers Now I get this message on top of the webui models loading list: A matching Triton is...
### 🧐 问题描述 | Proposed Solution I can see in the readme that it connects to openAI api, and text-generation webui created an api at 127.0.0.1:5000/v1 Where do I put...