theScotchGame

Results 3 comments of theScotchGame

> It's not expected, no. I have no explanation for it. Are you able to generate anything while the GPU is in this state? ![image](https://github.com/turboderp/exllama/assets/36061851/bab42365-4bbd-432a-b9a2-5918fbacd28d) After I unload the model,...

> It must be a ROCm issue of some sort, because there's nothing running in the background, no threads or anything. There's the asynchronous device queue, but the host code...

> Well, it's a Torch kernel (`elementwise_kernel`) which unfortunately is called all the time for any sort of element-wise operation, so it's anyone's guess what it's doing. > > But...