doris
doris copied to clipboard
apache
[chore](cloud) Run GC if not enough memory when checkpoint
Proposed changes
Issue Number: close #xxx
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
TPC-H: Total hot run time: 40007 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 33321c234fbcd1af915f3ffa5caf2167c791246e, data reload: false
------ Round 1 ----------------------------------
q1 17644 4334 4252 4252
q2 2014 181 190 181
q3 10565 1273 1250 1250
q4 10413 798 766 766
q5 7741 2679 2676 2676
q6 217 132 135 132
q7 957 616 616 616
q8 9271 2083 2105 2083
q9 9530 6579 6592 6579
q10 9115 3721 3707 3707
q11 461 236 239 236
q12 465 224 218 218
q13 17790 2950 2971 2950
q14 265 214 220 214
q15 513 466 462 462
q16 509 383 395 383
q17 945 685 712 685
q18 8050 7503 7379 7379
q19 2930 1529 1522 1522
q20 646 302 308 302
q21 4886 3898 3143 3143
q22 335 271 282 271
Total cold run time: 115262 ms
Total hot run time: 40007 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4319 4206 4206 4206
q2 370 276 262 262
q3 2967 2789 2744 2744
q4 1821 1567 1548 1548
q5 5265 5269 5292 5269
q6 210 123 126 123
q7 2127 1679 1716 1679
q8 3163 3378 3293 3293
q9 8285 8315 8290 8290
q10 3896 3690 3683 3683
q11 576 499 492 492
q12 750 615 578 578
q13 17379 2955 2996 2955
q14 299 257 262 257
q15 514 474 468 468
q16 486 436 417 417
q17 1759 1496 1468 1468
q18 7738 7657 7538 7538
q19 1644 1552 1531 1531
q20 1986 1792 1781 1781
q21 4872 4777 4912 4777
q22 573 510 498 498
Total cold run time: 70999 ms
Total hot run time: 53857 ms
TPC-DS: Total hot run time: 167661 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 33321c234fbcd1af915f3ffa5caf2167c791246e, data reload: false
query1 932 378 361 361
query2 6464 2481 2350 2350
query3 6661 209 209 209
query4 19800 17244 17105 17105
query5 4140 419 414 414
query6 252 157 154 154
query7 4590 294 290 290
query8 243 182 176 176
query9 8595 2351 2343 2343
query10 442 275 260 260
query11 10505 10050 10178 10050
query12 133 90 90 90
query13 1640 368 362 362
query14 9056 5996 7587 5996
query15 262 172 170 170
query16 8127 265 262 262
query17 1844 520 515 515
query18 2093 270 271 270
query19 236 157 158 157
query20 93 87 87 87
query21 191 125 125 125
query22 4205 4009 3920 3920
query23 33709 33124 32802 32802
query24 11952 2894 2893 2893
query25 663 354 362 354
query26 1846 154 153 153
query27 3158 311 322 311
query28 7393 2010 2004 2004
query29 1046 616 596 596
query30 305 174 177 174
query31 980 779 757 757
query32 87 56 53 53
query33 762 267 268 267
query34 1063 469 478 469
query35 749 606 591 591
query36 1083 914 903 903
query37 282 69 67 67
query38 2904 2795 2782 2782
query39 857 797 775 775
query40 276 124 120 120
query41 46 44 47 44
query42 102 95 96 95
query43 593 558 541 541
query44 1199 714 731 714
query45 179 162 166 162
query46 1085 714 729 714
query47 1893 1791 1796 1791
query48 369 285 296 285
query49 1192 375 392 375
query50 772 384 387 384
query51 6806 6804 6742 6742
query52 104 89 87 87
query53 359 284 280 280
query54 1001 432 448 432
query55 76 71 71 71
query56 256 239 245 239
query57 1136 1047 1057 1047
query58 228 201 202 201
query59 3259 3230 3201 3201
query60 279 253 245 245
query61 91 89 90 89
query62 647 440 468 440
query63 309 280 285 280
query64 9784 2285 1710 1710
query65 3160 3095 3127 3095
query66 1353 335 327 327
query67 15220 14894 14782 14782
query68 4547 528 521 521
query69 448 261 262 261
query70 1164 1076 1172 1076
query71 395 272 267 267
query72 7698 2708 2541 2541
query73 729 325 326 325
query74 6111 5564 5622 5564
query75 3398 2594 2608 2594
query76 2844 964 1002 964
query77 390 267 264 264
query78 10199 9882 9658 9658
query79 2550 515 511 511
query80 1115 449 420 420
query81 528 251 243 243
query82 818 94 91 91
query83 243 168 169 168
query84 232 84 86 84
query85 1634 263 273 263
query86 524 305 311 305
query87 3341 3105 3107 3105
query88 4191 2324 2339 2324
query89 484 388 392 388
query90 1974 187 193 187
query91 134 108 108 108
query92 62 50 51 50
query93 1754 498 492 492
query94 1248 190 192 190
query95 418 314 317 314
query96 581 269 264 264
query97 3168 2965 3111 2965
query98 243 221 214 214
query99 1101 830 841 830
Total cold run time: 275383 ms
Total hot run time: 167661 ms
ClickBench: Total hot run time: 30.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 33321c234fbcd1af915f3ffa5caf2167c791246e, data reload: false
query1 0.04 0.03 0.04
query2 0.08 0.04 0.04
query3 0.23 0.04 0.04
query4 1.72 0.06 0.07
query5 0.49 0.49 0.50
query6 1.13 0.73 0.72
query7 0.03 0.02 0.01
query8 0.05 0.04 0.04
query9 0.55 0.48 0.51
query10 0.54 0.55 0.56
query11 0.16 0.11 0.11
query12 0.13 0.12 0.11
query13 0.60 0.59 0.59
query14 0.77 0.78 0.77
query15 0.83 0.81 0.81
query16 0.37 0.37 0.37
query17 0.97 0.98 1.00
query18 0.21 0.26 0.22
query19 1.85 1.84 1.73
query20 0.02 0.01 0.01
query21 15.45 0.71 0.67
query22 4.67 7.30 1.64
query23 18.29 1.37 1.36
query24 1.54 0.31 0.22
query25 0.15 0.08 0.08
query26 0.27 0.17 0.17
query27 0.08 0.08 0.07
query28 13.35 1.01 0.99
query29 12.61 3.28 3.22
query30 0.24 0.06 0.06
query31 2.88 0.39 0.37
query32 3.27 0.46 0.48
query33 2.90 2.89 2.96
query34 17.04 4.35 4.43
query35 4.44 4.50 4.47
query36 0.65 0.49 0.46
query37 0.18 0.16 0.15
query38 0.16 0.14 0.15
query39 0.04 0.04 0.04
query40 0.16 0.14 0.15
query41 0.09 0.05 0.05
query42 0.06 0.04 0.04
query43 0.04 0.03 0.03
Total cold run time: 109.33 s
Total hot run time: 30.23 s
PR approved by at least one committer and no changes requested.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}