ardfork comments

Repositories
Issues
Comments

Results 13 comments of


                                            ardfork

Fix half2 with HIP

That work now. Look like the change in hip_compat.cuh weren't taken into account when rebuilding. I wonder if adding a useless change in q4_mlp to force it to be rebuild...

Fix half2 with HIP

> I raised an issue with hipamd for h2rcp() They have moved hipamd to https://github.com/ROCm-Developer-Tools/clr, might be a good idea to also put your issue on that new repo, I...

ImportError: /home/myuser/.cache/torch_extensions/py310_cpu/exllama_ext/exllama_ext.so: undefined symbol: hipblasGetStream

Can you try hiding your APU? I only had problems trying to use mine. `HIP_VISIBLE_DEVICES=0,1 ROCR_VISIBLE_DEVICES=0,1`