Xiaobing
Xiaobing
found another related issue: https://github.com/apache/pinot/issues/6343
Proposed some ideas about how to tackle this issue in [design doc](https://docs.google.com/document/d/1B_8k2XGMrxfFAo_g-MEjEPGj84Xy8YW4-yUiZ2BQkuE/edit#heading=h.2ic29gs71g43). Feel free to comment.
I just read a bit about the delta lib. A simple flow may look like below, where we can open the delta table with the lib and loop through all...
Yeah, I opened this issue early on and WIP on it: https://github.com/apache/pinot/issues/8843 feel free to leave comment there or tag me here for further discussion.
some quick thoughts but need verify: although we do delete the files in a finally{} upon task completion, but we may not release all the mmap over those files, which...
> High level question: why is the logic implemented in the table rebalancer? IMO it should be part of the tier assigner The design decision was made to extend SegmentRelocator...
A new target tier can lead to two reactions: 1) segment needs to go to a new server (when the target tier is only defined for a specific pool of...
> ... Basically after assigning the tier, we should trigger the reload immediately, instead of relying on another periodic task to trigger it. I think there may be use cases...
not able to reproduce failure on my local; and didn't spot this test case being flaky recently. but lemme know if you've noticed any recent failure on this test case.