opea-project
[Feature] Support launching multiple GenAI-Examples on one Machine
Priority
Undecided
OS type
Ubuntu
Hardware type
Xeon-GNR
Running nodes
Single Node
Description
Support launching multiple GenAI-Examples on one Machine.
To launch multiple GenAI-Examples on one Machine, host service ports should be configurable in case there is confliction.
Resolve software resources conflict: host network port conflict, Resolve hardware resources conflict: Compute resource /CPU, Accelerator conflict, memory capacity
It’s a reasonable request, particularly for new users getting started. However, enterprise users typically prefer scalable deployments tailored for specific use cases. Given that, I consider this a lower priority issue, and we’ll address it based on available resources.
