doris icon indicating copy to clipboard operation
doris copied to clipboard

[enhancement](memtracker) Add special counter for memtracker and fix thread create and destroy track

Open xinyiZzz opened this issue 2 years ago • 4 comments

Proposed changes

Issue Number: close #xxx

Problem summary

  1. Add a special counter for memtracker, faster, but relaxed ordering and not accurate in real time
  2. Track thread create and destroy memory, which was previously removed due to performance loss and added back

Checklist(Required)

  • [ ] Does it affect the original behavior
  • [ ] Has unit tests been added
  • [ ] Has document been added or modified
  • [ ] Does it need to update dependencies
  • [ ] Is this PR support rollback (If NO, please explain WHY)

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

xinyiZzz avatar Mar 01 '23 11:03 xinyiZzz

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar Mar 01 '23 11:03 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar Mar 01 '23 11:03 github-actions[bot]

run buildall

xinyiZzz avatar Mar 01 '23 11:03 xinyiZzz

TeamCity pipeline, clickbench performance test result: the sum of best hot time: 34.36 seconds stream load tsv: 471 seconds loaded 74807831229 Bytes, about 151 MB/s stream load json: 36 seconds loaded 2358488459 Bytes, about 62 MB/s stream load orc: 67 seconds loaded 1101869774 Bytes, about 15 MB/s stream load parquet: 28 seconds loaded 861443392 Bytes, about 29 MB/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230301123132_clickbench_pr_106481.html

hello-stephen avatar Mar 01 '23 12:03 hello-stephen