Paul Doucet

icon location France icon location Machine Learning Engineer at Modella A.I.

Results 1 comments of Paul Doucet

Is it possible to support multiple endpoints for one server?

Hi @aniketmaurya , In the [MultipleModelAPI ](https://lightning.ai/docs/litserve/features/multiple-endpoints), when using `max_batch_size `> 1, it seems like requests for different models will be batched together, is that correct? Is there a way...