quickwit
quickwit copied to clipboard
Implement an IndexManagementService to centralize CRUD operations on indexes
Notes
- Add the
IndexManagementServiceinquickwit-index-managementnew project. - Implement the gRPC client so that other nodes can make gRPC calls for CRUD index operations.
- Move the garbage collect to the
IndexManagementService - Add garbage collection of local splits (
IndexingSplitStore). - Start the service on the
ControlPlanenode. - (optional) Add REST API available on the Control Plane only.
- Update the CLI to use the gRPC client or REST API.
Related issues
- When starting a node, make sure there is a control plane node available
- If the control plane node shuts down, indexing pipelines should not restart indefinitely
- Make sure there is only one Control Plane in the cluster.