Dilip Parasu
Dilip Parasu
Either cuda is not installed, or CUDA vars are not present in the PATH.
I have some A100s, if you want some numbers from there
Makes sense. It dosent come up when the GCC version 11 or lower. In my case, when I was using it locally, I got the issue. My local GCC is...
So in this case, is the workaround able to preserve the inputs and the outputs of this route.. I have a similar issue working with FastAPI streaming responses.. At the...
In my scripts, I dont use device map, Accelerate handles it on its own. What happens if you dont pass the device map arg?
Hello, I am running into the same issue (i am running the isard-portal service itself) I am facing this issue on dual-socket system... Here is more info on the logs...
Hi, here are some more info.. The isard-portal (https://gitlab.com/isard/isardvdi) builds on top of official haproxy docker images (i believe the current one runs on `haproxy:3.1.1-alpine3.21` ) There is 17 services...
Okay.. I am trying this on all the 3 system configs I mentioned.. I will get back if any of the servers start throwing error
Just to be sure, should I create a cgroup and do it under it, or just config change would work?
Update - No crash till now. In case you are releasing patches that correspond to this issue, please mention here, I'll be very happy to test them and get back...