Kokoro-FastAPI icon indicating copy to clipboard operation
Kokoro-FastAPI copied to clipboard
Published 1 month ago • verified publisher icon remsky

Hope to be able to support high concurrency

Open leiax00 opened this issue 6 months ago • 1 comments

Hope to be able to support high concurrency the single instance currently used in the whole system, and it seems that pipline's inference process is blocked;

As a result, requests are queued all the time

leiax00 avatar Jul 09 '25 11:07 leiax00

I guess a workaround for now would be to spin up multiple python processes?

Amirjab21 avatar Sep 19 '25 12:09 Amirjab21