ozone icon indicating copy to clipboard operation
ozone copied to clipboard

[DRAFT] Raft group for each bucket

Open juncevich opened this issue 11 months ago • 6 comments

What changes were proposed in this pull request?

Test performance improvements when each bucket will have own raft group

juncevich avatar Feb 04 '25 12:02 juncevich

This is an idea discussed multiple times to increase the OM bandwidth for update APIs by leveraging multi Ratis. Thank you for initiating this. Did you get any performance numbers? If you want to pursue this, I would open a Jira with a write up along with the draft code. I would also recommend you take a look at https://issues.apache.org/jira/browse/HDDS-11897 which increases OM write performance 3x and simplifies the code quite a bit specially for post ratis submit.

kerneltime avatar Feb 04 '25 22:02 kerneltime

Hi @kerneltime! This is a rough implementation. Check 'what if we reduce the impact of Raft on performance.' Tests showed that file writing with OM HA off was about 7 times faster. Once I make sure it runs correctly, I will start load testing. Regarding the task, I’ve already looked into it. It seems to me that it's somewhat about something else.

juncevich avatar Feb 05 '25 08:02 juncevich

This PR has been marked as stale due to 21 days of inactivity. Please comment or remove the stale label to keep it open. Otherwise, it will be automatically closed in 7 days.

github-actions[bot] avatar Nov 12 '25 00:11 github-actions[bot]

I'd like to keep this open. I have seen some development on the @vtutrinov 's fork (https://github.com/vtutrinov/ozone/pull/1).

ivandika3 avatar Nov 12 '25 01:11 ivandika3

This PR has been marked as stale due to 21 days of inactivity. Please comment or remove the stale label to keep it open. Otherwise, it will be automatically closed in 7 days.

github-actions[bot] avatar Dec 04 '25 00:12 github-actions[bot]

Design doc and an initial implementation are in progress

vtutrinov avatar Dec 04 '25 07:12 vtutrinov

This PR has been marked as stale due to 21 days of inactivity. Please comment or remove the stale label to keep it open. Otherwise, it will be automatically closed in 7 days.

github-actions[bot] avatar Dec 26 '25 00:12 github-actions[bot]

Thank you for your contribution. This PR is being closed due to inactivity. If needed, feel free to reopen it.

github-actions[bot] avatar Jan 02 '26 00:01 github-actions[bot]