[DRAFT] Raft group for each bucket
What changes were proposed in this pull request?
Test performance improvements when each bucket will have own raft group
This is an idea discussed multiple times to increase the OM bandwidth for update APIs by leveraging multi Ratis. Thank you for initiating this. Did you get any performance numbers? If you want to pursue this, I would open a Jira with a write up along with the draft code. I would also recommend you take a look at https://issues.apache.org/jira/browse/HDDS-11897 which increases OM write performance 3x and simplifies the code quite a bit specially for post ratis submit.
Hi @kerneltime! This is a rough implementation. Check 'what if we reduce the impact of Raft on performance.' Tests showed that file writing with OM HA off was about 7 times faster. Once I make sure it runs correctly, I will start load testing. Regarding the task, I’ve already looked into it. It seems to me that it's somewhat about something else.
This PR has been marked as stale due to 21 days of inactivity. Please comment or remove the stale label to keep it open. Otherwise, it will be automatically closed in 7 days.
I'd like to keep this open. I have seen some development on the @vtutrinov 's fork (https://github.com/vtutrinov/ozone/pull/1).
This PR has been marked as stale due to 21 days of inactivity. Please comment or remove the stale label to keep it open. Otherwise, it will be automatically closed in 7 days.
Design doc and an initial implementation are in progress
This PR has been marked as stale due to 21 days of inactivity. Please comment or remove the stale label to keep it open. Otherwise, it will be automatically closed in 7 days.
Thank you for your contribution. This PR is being closed due to inactivity. If needed, feel free to reopen it.