doris
doris copied to clipboard
apache
[wip-enhance](tablet) Ignore expired stale rowsets when load tablets
Proposed changes
Ignore expired stale rowsets while loading tablet meta during BE booting up.
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
TPC-H: Total hot run time: 41847 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8693294c88697ffecfdc199d4e595d3af5eaa5ae, data reload: false
------ Round 1 ----------------------------------
q1 17610 4363 4230 4230
q2 2020 197 194 194
q3 10462 1327 1202 1202
q4 10198 867 834 834
q5 7478 2702 2739 2702
q6 219 130 129 129
q7 956 621 603 603
q8 9211 2161 2097 2097
q9 9948 6763 6721 6721
q10 9240 3836 3830 3830
q11 453 239 244 239
q12 468 223 227 223
q13 18262 3145 3226 3145
q14 247 200 220 200
q15 523 457 478 457
q16 489 403 395 395
q17 990 676 726 676
q18 8431 7779 7720 7720
q19 5215 1641 1611 1611
q20 651 317 315 315
q21 5073 3988 4123 3988
q22 403 336 337 336
Total cold run time: 118547 ms
Total hot run time: 41847 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4604 4374 4478 4374
q2 372 270 268 268
q3 3185 2941 2733 2733
q4 1894 1583 1680 1583
q5 5463 5458 5509 5458
q6 211 123 128 123
q7 2148 1848 1805 1805
q8 3217 3373 3385 3373
q9 8595 8680 8693 8680
q10 3973 3715 3830 3715
q11 606 507 499 499
q12 792 621 611 611
q13 15922 3099 3181 3099
q14 294 287 269 269
q15 522 475 487 475
q16 494 439 431 431
q17 1829 1484 1472 1472
q18 7633 7773 7472 7472
q19 1734 1609 1620 1609
q20 2013 1812 1798 1798
q21 9727 4806 4692 4692
q22 582 541 508 508
Total cold run time: 75810 ms
Total hot run time: 55047 ms
TeamCity be ut coverage result: Function Coverage: 36.28% (9228/25439) Line Coverage: 27.63% (75676/273938) Region Coverage: 26.84% (39168/145929) Branch Coverage: 23.60% (19883/84266) Coverage Report: http://coverage.selectdb-in.cc/coverage/8693294c88697ffecfdc199d4e595d3af5eaa5ae_8693294c88697ffecfdc199d4e595d3af5eaa5ae/report/index.html
TPC-DS: Total hot run time: 171627 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8693294c88697ffecfdc199d4e595d3af5eaa5ae, data reload: false
query1 918 381 378 378
query2 6441 2384 2180 2180
query3 6633 214 212 212
query4 19276 17475 17415 17415
query5 4155 460 429 429
query6 268 161 149 149
query7 4595 312 291 291
query8 310 286 285 285
query9 8639 2397 2379 2379
query10 463 282 277 277
query11 10664 10043 10139 10043
query12 129 89 89 89
query13 1630 362 357 357
query14 10071 6860 8029 6860
query15 227 197 186 186
query16 7787 272 257 257
query17 1528 526 511 511
query18 1951 273 273 273
query19 201 149 153 149
query20 94 80 85 80
query21 196 138 132 132
query22 4081 3912 3863 3863
query23 33574 32990 33113 32990
query24 6957 2863 2762 2762
query25 574 363 381 363
query26 705 153 153 153
query27 2045 323 320 320
query28 3580 2103 2086 2086
query29 853 609 597 597
query30 253 149 152 149
query31 991 770 746 746
query32 94 53 55 53
query33 491 266 263 263
query34 880 472 477 472
query35 717 610 609 609
query36 1074 904 907 904
query37 105 67 69 67
query38 2966 2797 2753 2753
query39 904 790 788 788
query40 197 126 125 125
query41 52 54 50 50
query42 104 98 99 98
query43 605 556 549 549
query44 1107 739 747 739
query45 189 171 170 170
query46 1062 719 694 694
query47 1835 1812 1769 1769
query48 363 304 308 304
query49 863 378 403 378
query50 784 374 377 374
query51 6654 6670 6538 6538
query52 105 88 92 88
query53 357 289 288 288
query54 545 431 422 422
query55 78 74 74 74
query56 269 246 266 246
query57 1146 1023 1053 1023
query58 227 209 201 201
query59 3270 2986 3130 2986
query60 279 290 259 259
query61 93 90 84 84
query62 582 466 463 463
query63 308 284 285 284
query64 8459 2266 1743 1743
query65 3138 3084 3127 3084
query66 793 329 326 326
query67 15192 14967 14706 14706
query68 4512 546 545 545
query69 446 267 270 267
query70 1186 1090 1058 1058
query71 382 270 264 264
query72 7448 5495 5426 5426
query73 731 337 320 320
query74 6045 5648 5629 5629
query75 3390 2603 2635 2603
query76 2323 989 996 989
query77 385 268 268 268
query78 10326 9944 9752 9752
query79 2434 522 523 522
query80 992 439 425 425
query81 526 224 214 214
query82 1306 90 94 90
query83 243 178 170 170
query84 250 85 89 85
query85 1282 266 267 266
query86 461 313 299 299
query87 3263 3104 3128 3104
query88 3929 2357 2344 2344
query89 470 398 391 391
query90 2050 193 192 192
query91 134 109 110 109
query92 57 50 52 50
query93 2644 516 501 501
query94 1302 196 195 195
query95 410 319 323 319
query96 597 272 263 263
query97 3223 2973 2994 2973
query98 238 222 216 216
query99 1136 843 863 843
Total cold run time: 259797 ms
Total hot run time: 171627 ms
ClickBench: Total hot run time: 30.56 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8693294c88697ffecfdc199d4e595d3af5eaa5ae, data reload: false
query1 0.04 0.03 0.03
query2 0.08 0.04 0.04
query3 0.22 0.05 0.05
query4 1.68 0.07 0.07
query5 0.50 0.48 0.50
query6 1.12 0.73 0.73
query7 0.02 0.01 0.01
query8 0.05 0.04 0.04
query9 0.53 0.49 0.49
query10 0.55 0.54 0.53
query11 0.15 0.12 0.11
query12 0.14 0.12 0.11
query13 0.59 0.60 0.61
query14 0.79 0.79 0.79
query15 0.83 0.80 0.81
query16 0.35 0.34 0.36
query17 0.94 0.97 0.97
query18 0.22 0.22 0.24
query19 1.77 1.73 1.74
query20 0.02 0.01 0.01
query21 15.75 0.66 0.66
query22 4.08 8.14 1.87
query23 18.29 1.27 1.27
query24 1.39 0.33 0.28
query25 0.15 0.09 0.08
query26 0.27 0.16 0.16
query27 0.08 0.08 0.08
query28 13.32 1.00 0.98
query29 13.72 3.29 3.28
query30 0.23 0.05 0.05
query31 2.88 0.38 0.37
query32 3.30 0.46 0.46
query33 2.88 2.92 2.94
query34 16.93 4.39 4.45
query35 4.50 4.51 4.63
query36 0.66 0.46 0.47
query37 0.17 0.16 0.15
query38 0.16 0.14 0.15
query39 0.05 0.04 0.03
query40 0.17 0.14 0.14
query41 0.09 0.05 0.05
query42 0.06 0.06 0.05
query43 0.04 0.03 0.04
Total cold run time: 109.76 s
Total hot run time: 30.56 s