Gaurav Kumbhat

Add reconfig poll patch

1

This patch is essentially porting the patch submitted by @njhill in PR #1518 to `2.4.0` version Currently when the configured model list is updated via a call to handleReloadConfigRequest, the...

### Changes - Remove `turtle` module import, since it doesn't seem to be getting used and breaks aif360 Signed-off-by: Gaurav Kumbhat

Implement batched run support for runtime

1

### Description Currently `caikit.runtime` only supports `.run` flavor of the call, this means we cannot support usecases where the input requires to be a list of document (for NLP domain)....

Thanks for awesome tutorial. It was very helpful. There were a few tiny changes I found so wanted to contribute it back. ### Changes 1. path inside the module now...

mixins: Add mechanism to install custom files into container

2

/kind feature **Describe the solution you'd like** When a model runtime starts, sometimes a user might need to install custom libraries into the container. Usually these libraries would go into...

### Changes This PR allows gine pro users to apply endpoint configuration, such as keep alive, available in tonic.