[Meta] Decommissioning and recommissioning a zone

[gbbafna]

Is your feature request related to a problem? Please describe.

There are use-case where decommissioning a zone/rack might be beneficial

1. In a multi-zone deployment setup it might be good to support zonal deployment rather than a rolling restart per node, which might be too slow for a big cluster and might take sufficiently longer. In such a case zone serves a unit of deployment
2. Andon cord during zonal outages is another handy mechanism which enables graceful traffic shutdown in the impacted zone/rack espl when certain nodes are still operating in a degraded manner

This issue lists the high level tasks . For more info on feature proposal, please refer: https://github.com/opensearch-project/OpenSearch/issues/3402 .

Tasks

• [ ] [Zone Decommission] APIs to decommission and storing the metadata
• [ ] [Zone Decommission] Abdicating the cluster manager if in decommissioned zone
• [ ] [Zone Decommission] Graceful decommission
• [ ] [Zone Decommission] Removal of nodes in decommissioned zone

[imRishN]

Adding more meta tasks here -

• [x] #4083
• [ ] #4368
• [x] #4369
• [x] #4370
• [x] #4371
• [ ] #4372
• [ ] #4528
• [x] #4543
• [x] #4571
• [ ] #4618
• [x] #4640
• [ ] #4615
• [x] #4750
• [ ] #4768
• [x] #4799
• [x] #4838
• [ ] #4654
• [x] #4803
• [ ] #4804
• [ ] #4721
• [x] #4720
• [ ] #5074
• [x] #5075

[anasalkouz]

@imRishN @gbbafna I have update this META issue by adding couple of Zone Decommission issues