celeborn icon indicating copy to clipboard operation
celeborn copied to clipboard
verified publisher icon apache

[CELEBORN-1487] CongestionController support control traffic by user/worker traffic speed

Open leixm opened this issue 1 year ago • 5 comments

What changes were proposed in this pull request?

Introduce support control traffic by user/worker traffic speed.

Why are the changes needed?

Currently, Celeborn only supports quota management based on disk file bytes/count, and this quota management cannot cope with sudden increases in traffic, which will cause corrupt to the cluster.

Does this PR introduce any user-facing change?

Yes.

How was this patch tested?

UTs.

leixm avatar Jul 09 '24 11:07 leixm

https://docs.google.com/document/d/1Qe80fCS96TI_C-_cQiJ6dLUXmIOdsiQhZDaMpl3ssiM/edit?usp=sharing cc @RexXiong @AngersZhuuuu Can you help review design doc?

leixm avatar Jul 12 '24 10:07 leixm

Can you open up access to the doc @leixm ? Thanks

mridulm avatar Jul 12 '24 17:07 mridulm

Can you open up access to the doc @leixm ? Thanks

Sorry, I have updated the doc access, can you access now?

leixm avatar Jul 14 '24 17:07 leixm

Flaky test.

leixm avatar Jul 16 '24 04:07 leixm

This PR is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 10 days.

github-actions[bot] avatar Aug 05 '24 08:08 github-actions[bot]

This issue was closed because it has been staled for 10 days with no activity.

github-actions[bot] avatar Aug 16 '24 08:08 github-actions[bot]