HDDS-7244. Fix multiple reports queued up from same DN and using up heap

Open sumitagrawl opened this issue 3 years ago • 2 comments

What changes were proposed in this pull request?

Customized Queue "ContainerReportQueue" in created to control the number of FCR for datanode to one only as latest report, and avoid old duplicate FCR report.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-7244

How was this patch tested?

ThreadPool changes are tested using Unit test
ContainerReportQueue using unit test
SCM and Recon processing E2E using Intellij and debugger to simulate slow processing.

Sep 27 '22 09:09 sumitagrawl

@ChenSammi @nandakumar131 Plz review

Sep 27 '22 09:09 sumitagrawl

Hi @kerneltime , would you like to take a look of this PR?

Oct 10 '22 05:10 ChenSammi

@adoroszlai plz review

Oct 19 '22 01:10 sumitagrawl

@kerneltime Please review

Oct 25 '22 09:10 sumitagrawl

The last patch LGTM + 1.
Thanks @sumitagrawl for the feature improvement, and @adoroszlai for the code review.

Oct 31 '22 07:10 ChenSammi