curvedinf
curvedinf
I have solved this by updating the venv's torch and torchvision versions to the latest nightlies. I also am running the latest ROCM driver (6.0.2). There are multiple ways to...
MoE looks promising. Any word on how complex it is to add support for?
@harkgill-amd That fix is actually how I got it working. I spent some time reading about the different modes of amdgpu-install and gave that a shot. So I can confirm...
Hi I'm also interested in AMD support. I'd prefer OpenCL or Vulkan to ROCm since they don't require special drivers and are ballpark the same performance. Llama.cpp's vulkan implementation is...
+1 If you need some help maintaining, I'll step up.