Mohamed Yassin
Mohamed Yassin
Hi @DavideRossi , I had similar errors, but 8 bit quantization is working for me on ROCm now. I have added a comment with steps I took in the bitsandbytes...
> Thanks @mohamedyassin1 what you describe is very similar to my own setup. Can I ask you to paste the output of `python -m bitsandbytes` from your system? Sure: ```...