Mr.Userbox
I need to use psutil on cygwin, im waiting since 2014 im getting mad at you, last person i got mad with, died.
> what is the kompute doing for? It theorically optimize performance for some gpus
@phymbert thanks bro, going to check with lower quantz, do you know which one its the maximum it suporrt? in your code snippet looks like only q4 and f32 and...
> Same issue here. Vulkan works ok-isch on my AMD Vega VII with about 20% GPU usage. Kompute does not work with models I tested like https://huggingface.co/TheBloke/WizardLM-1.0-Uncensored-Llama2-13B-GGUF > > Click...
Thats not make sense, kompute it's an optimized vulkan. Something must be wrong programmed or configurated. I managed to install llamacpp kompute but because it's still on development and only...
Issue solved with new windows version
sup bros, you guys rocks im just a hobbist you wou guys are way off my league. I have a rx 6700 (gfx1031) that wanted to use with llamacpp and...
> > i have an old rx 5700 but dont know how to compile or env variables to enable to make it work llamacpp on multigpu > > `export HCC_AMDGPU_TARGET=gfx1030,gtx1010`...
Interesting going to take a look at rocm5.5 however i want to run llamacpp with my rx5700 and i think it only supports rocm5.6 and 5.7
> Interesting going to take a look at rocm5.5 however i want to run llamacpp with my rx5700 and i think it only supports rocm5.6 and 5.7 > @cgmb