SoftologyPro
SoftologyPro
I have the same Half Float issue with the last git code. I use it outside conda in a custom venv with these packages (if that helps) scipy==1.9.3 scikit-image==0.19.3 diffusers==0.6.0...
Still fails here. I downloaded the latest zip, and extracted over all the existing files.
Thanks for the solution. Adding the --fp32 parameter got it working here.
Copying the dll and modifying main.py as in this comment https://github.com/oobabooga/text-generation-webui/issues/147#issuecomment-1456040134 got past the bitsandbytes error, but now; llama-7b-hf model loads the model shards but then errors out with "ValueError:...
For the LLaMATokenizer issue you need a different transformers, ie pip uninstall -y transformers pip install git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176 That gets llama-7b-hf loading and working again.
It started with the latest update yesterday. If you close it now every person using the one-click installer is going to have these same problems.
But what about the problem? It started just yesterday. Can it be rolled back to the working version? If it is not fixed every Windows user who uses the one-click...
@xNul I have fixes above. I was hoping the dev(s) would fix the git so I don't have to patch it every update.
sed does not work by default in Windows so one click installer fails.
OK, I worked this one out. (I am running this under Windows if that matters.) It seems as if the paths to the models in the config file must be...