doris icon indicating copy to clipboard operation
doris copied to clipboard

[enhance](cooldown) turn write cooldown meta async

Open ByteYue opened this issue 2 years ago • 6 comments

Proposed changes

Issue Number: close #xxx Upload meta file first once this replica is chosen to be new cooldown replica. Consider such case: replica A: term 15, replica B: term 14, replica C: term 15 and the former cooldown replica is A if FE chooses C to be the new cooldown replica, and B tries to follow C now, B wouldn't be able to find .meta file on remote storage

Problem summary

Describe your changes.

Checklist(Required)

  • [ ] Does it affect the original behavior
  • [ ] Has unit tests been added
  • [ ] Has document been added or modified
  • [ ] Does it need to update dependencies
  • [ ] Is this PR support rollback (If NO, please explain WHY)

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

ByteYue avatar Feb 16 '23 03:02 ByteYue

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Feb 16 '23 03:02 github-actions[bot]

TeamCity pipeline, clickbench performance test result: the sum of best hot time: 34.65 seconds stream load tsv: 472 seconds loaded 74807831229 Bytes, about 151 MB/s stream load json: 37 seconds loaded 2358488459 Bytes, about 60 MB/s stream load orc: 76 seconds loaded 1101869774 Bytes, about 13 MB/s stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230307182003_clickbench_pr_110297.html

hello-stephen avatar Feb 16 '23 05:02 hello-stephen

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Feb 23 '23 07:02 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 02 '23 07:03 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 03 '23 11:03 github-actions[bot]

run buildall

ByteYue avatar Mar 03 '23 11:03 ByteYue

run buildall

ByteYue avatar Mar 05 '23 04:03 ByteYue

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 05 '23 04:03 github-actions[bot]

run buildall

ByteYue avatar Mar 05 '23 10:03 ByteYue

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 05 '23 10:03 github-actions[bot]

run buildall

ByteYue avatar Mar 06 '23 09:03 ByteYue

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 06 '23 09:03 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 07 '23 03:03 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 07 '23 06:03 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 07 '23 07:03 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Mar 07 '23 11:03 github-actions[bot]

run buildall

ByteYue avatar Mar 07 '23 14:03 ByteYue