KServe

https://kserve.github.io/website [email protected]

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes