Alex Rakowski

Hi @MarcinSkrobczynski, As you have spotted, MLServer spawns a number of worker processes (4 by detault) for each model. This number is controlled by the parameter [parallel_workers](https://mlserver.readthedocs.io/en/latest/reference/model-settings.html#mlserver.settings.ModelSettings.parallel_workers) and can be...

Hi @MarcinSkrobczynski, If you're using a suffficiently recent version of Docker, it supports [memory limits](https://docs.docker.com/config/containers/resource_constraints/#limit-a-containers-access-to-memory) and [disabling swap space](https://docs.docker.com/config/containers/resource_constraints/#prevent-a-container-from-using-swap). You can set these to sensible values for the machine you're...

> It does seem we're getting a consistent operator unit test fail, I can't seem to reproduce in master so seems will require updating This is strange, as no operator...

Hi @chijunqing, The elements under `spec.predictors.componentSpecs` are **pod** specifications, not deployment ones. As a result, the `progressDeadlineSeconds` field does not belong here -- it is not part of a pod...

Hi @chijunqing, # 1 - stuck in creating state It's possible to patch `progressDeadlineSeconds` into a deployment [after its creation](https://kubernetes.io/docs/concepts/workloads/controllers/deployment/#failed-deployment): ``` kubectl patch deployment/ -p '{"spec":{"progressDeadlineSeconds": }}' ``` So, it's...

From spinning up a `kind` cluster and testing with the manifest you provided above, it looks like changing a deployment works for a plain deployment, but not one managed by...

I may have time to look at this today, although I may not finish it until next week. If it's more urgent, you're welcome to put in a PR over...

Testing these changes was a bit of a convoluted process but did confirm the intended behaviour. For reference, I did the following: * Created a fresh kind cluster called `ansible`...

> Nice one @agrski ! Will test from branch and review. Seems executor test failed but we need to validate if its just the flaky one. > > /text integration...

Force pushed after rebasing onto master