apache
feat: Can the preheating capability be added to newly created pods?
Description
For the application of Java technology stack, directly accepting the full amount of traffic after the pod is healthy will cause excessive timeout problems. Can the initial weight be set smaller for newly created pods (including elastic expansion or rolling updates), and every certain interval Time increases until it returns to the default weight.
Basically you want to slowly increase the weight of an upstream from X to Y within a time period T after first connection. Am I right?
@Donghui0 Hi!
As an alternative, you can use balancing type EWMA.
Apisix supports this balancing mechanism (ewma). And it is very effective when new Java pods start under high load. The load is applied smoothly as the underside warms up.
We use EWMA and everything is ok.
Although I also support that a slow_start option would be nice to have.
@Donghui0 Hi!
As an alternative, you can use balancing type EWMA.
Apisix supports this balancing mechanism (ewma). And it is very effective when new Java pods start under high load. The load is applied smoothly as the underside warms up.
We use EWMA and everything is ok.
Although I also support that a slow_start option would be nice to have.
Thank you very much. I'm testing the EWMA load balancing policy.