cloudflow icon indicating copy to clipboard operation
cloudflow copied to clipboard

Support scaling a streamlet to zero

Open michaelpnash opened this issue 5 years ago • 2 comments

This can be used to stop/pause processing of parts of the application, which can be useful in many scenarios. It also gives some more control to the user. We envisioned this a long time ago, but at that point it was in combination with viewing the data, possibly fixing it, and continuing again.

It might be that if you know there is no data coming in at all, you want to scale to 0 to minimize resource usage.https://github.com/kedacore/kedais for instance interesting, which supports kafka, and some sort of events that can autoscale objects in k8s. We could imagine something similar, where we scale a streamlet to 0 if no data has been received for x hours?

michaelpnash avatar Apr 23 '20 18:04 michaelpnash

@andreaTP I think in new cli this is supported. Let's give it a try if it really works.

RayRoestenburg avatar Dec 16 '20 14:12 RayRoestenburg

yup, should be working out of the box in the new cli, I will try it!

andreaTP avatar Dec 18 '20 17:12 andreaTP