Blake Wyatt

@kodra-dev I'm going to need some more info like what OS are you running, what's your install log, and what drive are you using?

@Shark-Eater your one-click installer is no longer supported. Try the new one https://github.com/oobabooga/text-generation-webui#installation

Glad it worked! Yeah I've seen other people having trouble running that model too. I'm not sure how to fix it. Most other models work well though like https://huggingface.co/wcde/llama-7b-4bit-gr128 works...

@Shark-Eater Sounds to me like GPTQ didn't install correctly. Try running `update_windows.bat` and then send me the log. It will probably error out at the end for the GPTQ part.

> @xNul So, the first Error is: (ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the...

@Shark-Eater are you sure you ran the scripts in the zip properly? Make sure you extract everything in the zip to another folder and then run `start_windows.bat`. If you still...

@Shark-Eater I'm going to need a log that goes back further than this because I need to see what happens when CUDA is installed which is causing the "CUDA extension...

@Shark-Eater > do you have any pointers to get an old log? Logs aren't saved anywhere so the only option is to copy-paste. Hmm the quant_cuda wheel seems to have...

@Shark-Eater that's so strange. I've never seen this error before (well except at the top of this issue). Can you open `cmd_windows.bat`, use the command `set`, and copy-paste the log?

@Shark-Eater open `cmd_windows.bat` again and try running the command `conda install -y -k pytorch[version=2,build=py3.10_cuda11.7*] torchvision torchaudio pytorch-cuda=11.7 cuda-toolkit ninja git -c pytorch -c nvidia/label/cuda-11.7.0 -c nvidia` Does it give the...