John-Henry Lim
John-Henry Lim
Try removing the trailing "/" on the URL. Otherwise it might be a https issue as I haven't really tested with https before.
Could you share your instructions on how you set AUTO up on Runpod? I will try and see if I can reproduce the issue. If the webUI works per normal,...
Yeah that would be more convenient, but there doesn't not seem to be a way to get the model's training size from the model itself. So unless most models store...
This would be superseded by having a working settings preset system.
Can you screenshot the console output? Should log "img size: ...x... -> ...x..." somewhere.
> Are there any new developments? Well uni started and I can't remember what I was doing here. I might end up trying the same thing again in the future...
isn't ollama practically a wrapper around llama.cpp though?
For anyone curious, huggingface has done it: https://huggingface.co/blog/kv-cache-quantization
Hi I am having the same issue.
For me, I noticed it seems to alternate. If the extension is installed, it will get uninstalled. If it is not installed, it will attempt to install. That said, the...