Indranil R Chowdhury

s2i-java-jni-runtime:0.5.1 security vulnerabilities

1

We have been using s2i-java-jni-runtime:0.5.1 and builder image to create java wrapper based model images in our project. Recent security scans on the model image using [Grype ](https://github.com/anchore/grype)has revealed several...

Helm charts for K8s deployment of Infinity

3

Although dockerized deployments are supported, an official helm chart would be very handy for K8s deployments. Is this already available ?

Upgrade to Spark 3.5

3

Any plans to upgrade to Spark 3.5 and the latest Xgboost 2.x ?

[NEW] Vector databse related support

1

**The problem/use-case that the feature addresses** Enable use of Valkey with LLM applications for semantic LLM caching, semantic conversation cache, LLM semantic routing **Description of the feature** - Introduce support...

Support Integration with KServe

1

### Feature request [Kserve](https://github.com/kserve/kserve) is a Kubernetes based engine for predictive and generative AI models and provides abstraction for popular model servers like Huggingface TEI (https://github.com/kserve/kserve/pull/3743), Tensorflow,PyTorch etc. Request to...

[FEATURE] Support LiteLLM Connector

2

**Is your feature request related to a problem?** Add LiteLLM as an out of box ML connector [Connectors - OpenSearch Documentation](https://docs.opensearch.org/latest/ml-commons-plugin/remote-models/connectors/#connector-blueprints) . For enterprise deployments LiteLLM Proxy acts as the...