Nuga
Is there any update on this particular issue?
Is there any update on this? Currently we have an issue for random `DataIntegrityViolationException` error when try to run Unit Test with Junit In local it's working, but in CI/CD...
Is there any update on this? It seems the issue is still open and nowhere to the solution?
> See here [#2573 (comment)](https://github.com/oobabooga/text-generation-webui/pull/2573#issuecomment-1620863925), it seems to me that this should already work, but it would be good to have someone actually test it with multiple users > >...
> WebUI works, API works but only one user at a time due to no batched inferencing. Everybody has to queue. How it works? I try in incognito and default...
How to apply the concurrent processing for inference requests? Glad to hear your response sir. Thank you
Hmmm what about the TGI with version 1.0.0+? Seems some flags are already sunsetted
Any update on this?
https://github.com/huggingface/optimum-neuron/tree/main/text-generation-inference Another tools from hugging face
@mrwyattii thanks