tonsOfStu

Results 5 comments of tonsOfStu

CUDA out of memory, despite having enough memory to run

What settings are you running at? I also have a 12GB card and it can not fit batch size of 4 or anything above 640x640

CUDA out of memory, despite having enough memory to run

Try lowering resolution to see if it works. Try some of the other versions as well. AUTOMATIC1111's works just fine.

Unable to install dependencies: No matching distribution found for triton==0.4.2

There is no triton library above 0.3 for Python 3.10. Try Ubuntu 20.04 + Python 3.8, 3.9

Unable to install dependencies: No matching distribution found for triton==0.4.2

Yes, this should work .. for now. The latest triton releases do not have anything for Python 3.10 or for Windows (I tried that too). I don't see anything being...

Interactive inference fails

The fix for the initial error led to "IndexError: : shape mismatch: indexing tensors could not be broadcast" error on any prompt above 1 word.