pulp
operator can auto-scale worker pods based on the tasks queue
Is your feature request related to a problem? Please describe. Operator should be able to monitor tasks queue and if there are a lot of tasks in waiting state it should scale up temporarily worker pods because it means there are not enough of workers to process tasks( bottleneck). Then operator should scale down worker pods once the task queue is empty (no bottleneck). Scaling down is important so pods do not consume resources in vain.
Describe the solution you'd like A clear and concise description of what you want to happen.
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.
Additional context Add any other context about the feature request here.
To enable this I think pulpcore needs to take the first step to expose observability data around the task queue waiting times and probably the task service times too. I wrote this issue for pulpcore here: https://github.com/pulp/pulpcore/issues/3389
