acheong08
Requests hanging
Context: I have the server running as a container in GCP cloud run, and am using the Mozilla agent
Problem: It seems to work for a few requests, but then quickly after I'm not sure exactly what happens but every request hangs and doesn't return anything. When there's no client connected often it will return no client connected, but once it correctly has a connection, everything hangs. In terms of errors, it's usually no error, or a 503. In addition, sometimes there's a correctly registered connection, but when a request comes in to /api/ask, it returns "No client connected".
I don't think so. It quickly can start hanging within 1~2 requests. I also have used multiple different accounts so I don't think it's tied to that.
Hanging requests might mean that the pool isn't getting unlocked. I'm having some issues debugging as I can't replicate it reliably
The official API via the completions endpoint has been released. I suggest you use that instead