Jin Dong
Jin Dong
**What this PR does / why we need it**: 1. Introduce model cache cr with storage uri and name 2. Add pvc name in storage initializer for all models. (which...
**What this PR does / why we need it**: This is built on top of #3839. 1. Implement local model controller that create download/delete jobs, create pv/pvcs in isvc namespaces....
**What this PR does / why we need it**: This PR introduces a cluster model cache CR and a node group CR. With these two PRs, you can define a...
/kind bug **What steps did you take and what happened:** [A clear and concise description of what the bug is.] Create an inference service with vllm, run a benchmark test....
/kind feature **Describe the solution you'd like** [A clear and concise description of what you want to happen.] torchserve is no longer actively maintained **Anything else you would like to...
/kind bug **What steps did you take and what happened:** [A clear and concise description of what the bug is.] Bug or feature request? 1. One user have a custom...
/kind bug **What steps did you take and what happened:** [A clear and concise description of what the bug is.] https://github.com/kserve/kserve/blob/d9149f69c55879201f94b134246a18061dcf92e4/python/kserve/kserve/model.py#L183-L187 This is required because we need `self.prodictor_host` https://github.com/kserve/kserve/blob/d9149f69c55879201f94b134246a18061dcf92e4/python/kserve/kserve/model.py#L206-L208 **What...
/kind feature **Describe the solution you'd like** [A clear and concise description of what you want to happen.] This file name is a bit confusing. `github.com/kserve/kserve/test/crds/serving.kserve.io_inferenceservices.yaml` includes all crds in...
/kind bug **What steps did you take and what happened:** [A clear and concise description of what the bug is.] https://github.com/kserve/kserve/actions/runs/13593303059/job/38004436759?pr=4277#logs ``` #17 [builder 10/12] RUN cd sklearnserver && poetry...