Brendan Graham
Brendan Graham
Able to reproduce this in TF2.9 (using `nvidia/tensorflow:22.08-tf2-py3`)
@Kludex what's the difference? Gunicorn: https://docs.gunicorn.org/en/stable/signals.html#master-process > TERM: Graceful shutdown. Waits for workers to finish their current requests up to the [graceful_timeout](https://docs.gunicorn.org/en/stable/settings.html#graceful-timeout). > > `graceful_timeout` > After receiving a restart...
Hm, but they both apply to the graceful termination of workers/tasks in the event of a signal to shutdown. Is there any reason to be concerned about making the Uvicorn...