doris icon indicating copy to clipboard operation
doris copied to clipboard

[opt](exchange) Add buffer size limit for exchange sink operator

Open mrhhsg opened this issue 1 year ago • 17 comments

Proposed changes

Issue Number: close #xxx

mrhhsg avatar May 30 '24 06:05 mrhhsg

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 30 '24 06:05 doris-robot

run buildall

mrhhsg avatar May 30 '24 06:05 mrhhsg

TeamCity be ut coverage result: Function Coverage: 36.27% (9231/25450) Line Coverage: 27.62% (75690/274037) Region Coverage: 26.83% (39169/145972) Branch Coverage: 23.59% (19887/84292) Coverage Report: http://coverage.selectdb-in.cc/coverage/074a5f25d0777e12d2372b561275817f667520b2_074a5f25d0777e12d2372b561275817f667520b2/report/index.html

doris-robot avatar May 30 '24 07:05 doris-robot

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 30 '24 09:05 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 30 '24 09:05 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 30 '24 09:05 github-actions[bot]

run buildall

mrhhsg avatar May 30 '24 12:05 mrhhsg

TPC-H: Total hot run time: 39917 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fd21ce0fec2c96eac4476b95fa14d37d237d8407, data reload: false

------ Round 1 ----------------------------------
q1	17612	4436	4269	4269
q2	2036	200	213	200
q3	10420	1244	1145	1145
q4	10158	734	728	728
q5	7458	2667	2672	2667
q6	216	135	135	135
q7	950	600	588	588
q8	9217	2075	2080	2075
q9	8843	6534	6499	6499
q10	8954	3700	3729	3700
q11	462	246	238	238
q12	534	232	225	225
q13	17766	2999	2974	2974
q14	261	217	216	216
q15	528	476	462	462
q16	522	386	380	380
q17	968	673	734	673
q18	8187	7423	7368	7368
q19	7349	1635	1607	1607
q20	657	310	313	310
q21	4966	3127	3890	3127
q22	396	338	331	331
Total cold run time: 118460 ms
Total hot run time: 39917 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4414	4225	4219	4219
q2	374	260	274	260
q3	2942	2736	2716	2716
q4	1838	1577	1561	1561
q5	5282	5276	5319	5276
q6	211	126	129	126
q7	2156	1792	1781	1781
q8	3197	3350	3353	3350
q9	8411	8351	8348	8348
q10	3912	3676	3666	3666
q11	600	488	484	484
q12	759	589	631	589
q13	17295	2990	3017	2990
q14	314	264	248	248
q15	526	483	486	483
q16	469	416	417	416
q17	1772	1493	1469	1469
q18	7721	7737	7534	7534
q19	1697	1565	1516	1516
q20	2003	1782	1776	1776
q21	4862	4692	4836	4692
q22	636	537	525	525
Total cold run time: 71391 ms
Total hot run time: 54025 ms

doris-robot avatar May 30 '24 12:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 36.30% (9231/25433) Line Coverage: 27.64% (75701/273891) Region Coverage: 26.86% (39183/145897) Branch Coverage: 23.62% (19896/84246) Coverage Report: http://coverage.selectdb-in.cc/coverage/fd21ce0fec2c96eac4476b95fa14d37d237d8407_fd21ce0fec2c96eac4476b95fa14d37d237d8407/report/index.html

doris-robot avatar May 30 '24 12:05 doris-robot

TPC-DS: Total hot run time: 170453 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fd21ce0fec2c96eac4476b95fa14d37d237d8407, data reload: false

query1	944	386	374	374
query2	6468	2580	2436	2436
query3	6652	212	218	212
query4	20730	17309	17379	17309
query5	4215	431	423	423
query6	257	165	157	157
query7	4560	314	298	298
query8	324	292	291	291
query9	8619	2397	2387	2387
query10	466	279	282	279
query11	10563	10141	10112	10112
query12	137	91	87	87
query13	1593	364	359	359
query14	9421	7173	7726	7173
query15	256	188	187	187
query16	7773	260	265	260
query17	1854	539	531	531
query18	1971	271	264	264
query19	207	160	153	153
query20	93	85	84	84
query21	204	143	131	131
query22	4126	3952	4017	3952
query23	33829	32992	33062	32992
query24	11974	2775	2803	2775
query25	688	346	362	346
query26	1815	159	157	157
query27	2932	327	322	322
query28	7598	2103	2086	2086
query29	1091	621	617	617
query30	309	153	154	153
query31	987	771	762	762
query32	91	57	57	57
query33	773	271	287	271
query34	995	487	482	482
query35	738	616	631	616
query36	1088	927	939	927
query37	159	65	71	65
query38	2907	2737	2749	2737
query39	853	794	802	794
query40	271	130	129	129
query41	55	52	52	52
query42	106	98	101	98
query43	597	599	542	542
query44	1190	748	750	748
query45	185	181	172	172
query46	1083	721	704	704
query47	1853	1755	1777	1755
query48	374	296	298	296
query49	1193	384	393	384
query50	776	406	395	395
query51	6726	6756	6704	6704
query52	104	92	92	92
query53	391	292	290	290
query54	954	433	425	425
query55	77	75	72	72
query56	260	241	244	241
query57	1140	1047	1031	1031
query58	234	213	214	213
query59	3541	3188	3077	3077
query60	281	258	263	258
query61	95	88	88	88
query62	662	447	460	447
query63	319	295	297	295
query64	9914	2215	1730	1730
query65	3227	3129	3114	3114
query66	1404	334	334	334
query67	15394	14839	15099	14839
query68	4628	552	549	549
query69	462	269	282	269
query70	1173	1155	1187	1155
query71	392	268	316	268
query72	7671	5472	2735	2735
query73	713	324	321	321
query74	6038	5760	5605	5605
query75	3318	2672	2613	2613
query76	2469	1026	986	986
query77	437	280	273	273
query78	10220	10079	9840	9840
query79	2601	521	524	521
query80	1065	450	441	441
query81	547	219	221	219
query82	939	94	93	93
query83	252	183	177	177
query84	236	90	86	86
query85	1255	298	316	298
query86	438	311	305	305
query87	3289	3160	3138	3138
query88	4178	2381	2453	2381
query89	494	396	383	383
query90	1968	195	189	189
query91	126	101	98	98
query92	67	52	53	52
query93	1824	525	507	507
query94	1260	190	184	184
query95	403	315	318	315
query96	590	272	272	272
query97	3182	3017	3002	3002
query98	260	222	219	219
query99	1126	873	816	816
Total cold run time: 276287 ms
Total hot run time: 170453 ms

doris-robot avatar May 30 '24 12:05 doris-robot

ClickBench: Total hot run time: 31.08 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fd21ce0fec2c96eac4476b95fa14d37d237d8407, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.03
query3	0.24	0.06	0.05
query4	1.68	0.07	0.07
query5	0.52	0.48	0.48
query6	1.12	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.53	0.49	0.49
query10	0.55	0.55	0.53
query11	0.16	0.12	0.11
query12	0.15	0.11	0.12
query13	0.59	0.58	0.60
query14	0.77	0.78	0.77
query15	0.83	0.80	0.80
query16	0.35	0.37	0.37
query17	0.98	0.94	0.97
query18	0.22	0.22	0.24
query19	1.85	1.79	1.79
query20	0.02	0.01	0.01
query21	15.60	0.68	0.66
query22	4.45	6.34	2.47
query23	18.30	1.34	1.30
query24	1.30	0.45	0.22
query25	0.14	0.09	0.09
query26	0.26	0.17	0.16
query27	0.08	0.09	0.08
query28	13.29	1.02	0.98
query29	13.20	3.32	3.26
query30	0.24	0.05	0.05
query31	2.88	0.38	0.37
query32	3.31	0.48	0.46
query33	2.89	2.85	2.90
query34	17.20	4.40	4.42
query35	4.49	4.54	4.54
query36	0.65	0.49	0.46
query37	0.17	0.15	0.17
query38	0.14	0.14	0.14
query39	0.04	0.03	0.04
query40	0.16	0.13	0.15
query41	0.10	0.05	0.06
query42	0.05	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.73 s
Total hot run time: 31.08 s

doris-robot avatar May 30 '24 12:05 doris-robot

run buildall

mrhhsg avatar May 30 '24 14:05 mrhhsg

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 30 '24 14:05 github-actions[bot]

TPC-H: Total hot run time: 41426 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c180e523bc696255a27dcfa48f028f1c299a52aa, data reload: false

------ Round 1 ----------------------------------
q1	17699	4399	4312	4312
q2	2030	200	198	198
q3	10739	1299	1287	1287
q4	10274	913	809	809
q5	7870	2717	2715	2715
q6	230	145	138	138
q7	975	626	618	618
q8	9636	2151	2105	2105
q9	9370	6692	6685	6685
q10	9069	3746	3716	3716
q11	494	246	248	246
q12	435	222	216	216
q13	17775	3005	2956	2956
q14	257	230	232	230
q15	521	468	471	468
q16	512	392	373	373
q17	958	735	757	735
q18	8236	7594	7535	7535
q19	1709	1623	1610	1610
q20	646	317	300	300
q21	5027	3849	3882	3849
q22	383	339	325	325
Total cold run time: 114845 ms
Total hot run time: 41426 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4342	4271	4277	4271
q2	384	266	266	266
q3	2954	2776	2754	2754
q4	1920	1673	1640	1640
q5	5260	5279	5257	5257
q6	213	128	129	128
q7	2176	1778	1686	1686
q8	3229	3320	3316	3316
q9	8392	8409	8403	8403
q10	3872	3747	3653	3653
q11	601	493	504	493
q12	790	575	601	575
q13	16581	2991	2997	2991
q14	291	266	265	265
q15	524	471	485	471
q16	496	422	420	420
q17	1774	1500	1469	1469
q18	7655	7452	7420	7420
q19	1702	1608	1504	1504
q20	2013	1787	1763	1763
q21	4959	4751	4655	4655
q22	641	533	525	525
Total cold run time: 70769 ms
Total hot run time: 53925 ms

doris-robot avatar May 30 '24 14:05 doris-robot

TPC-DS: Total hot run time: 170130 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c180e523bc696255a27dcfa48f028f1c299a52aa, data reload: false

query1	941	398	385	385
query2	6456	2411	2372	2372
query3	6652	216	215	215
query4	20156	17319	17471	17319
query5	4191	435	440	435
query6	255	173	155	155
query7	4578	300	290	290
query8	328	288	288	288
query9	8472	2412	2390	2390
query10	446	294	275	275
query11	10655	10216	10079	10079
query12	136	105	88	88
query13	1670	359	354	354
query14	9566	7539	6960	6960
query15	238	191	197	191
query16	7760	264	259	259
query17	1836	538	511	511
query18	1924	273	274	273
query19	207	154	153	153
query20	94	87	93	87
query21	199	142	127	127
query22	4093	3971	3931	3931
query23	33592	33142	33060	33060
query24	12099	2850	2927	2850
query25	677	353	358	353
query26	1821	156	160	156
query27	3030	317	325	317
query28	7692	2074	2065	2065
query29	1166	624	633	624
query30	302	149	152	149
query31	951	768	757	757
query32	93	53	58	53
query33	776	273	265	265
query34	1026	489	493	489
query35	725	622	600	600
query36	1040	916	924	916
query37	266	66	67	66
query38	2904	2751	2780	2751
query39	879	787	777	777
query40	270	131	140	131
query41	60	54	54	54
query42	105	102	98	98
query43	603	560	568	560
query44	1221	734	756	734
query45	183	181	172	172
query46	1073	723	752	723
query47	1864	1745	1738	1738
query48	369	293	302	293
query49	1177	381	425	381
query50	770	389	405	389
query51	6898	6790	6739	6739
query52	106	95	95	95
query53	359	296	311	296
query54	987	466	427	427
query55	117	74	71	71
query56	266	245	248	245
query57	1144	1037	1066	1037
query58	231	207	213	207
query59	3398	3186	3204	3186
query60	274	273	262	262
query61	92	86	101	86
query62	664	443	456	443
query63	321	291	299	291
query64	9841	2188	1721	1721
query65	3200	3112	3125	3112
query66	1383	331	323	323
query67	15160	14768	15006	14768
query68	4601	537	537	537
query69	505	264	279	264
query70	1142	1086	1169	1086
query71	423	278	275	275
query72	7404	5534	2709	2709
query73	724	340	325	325
query74	5949	5722	5624	5624
query75	3781	2626	2622	2622
query76	3309	1004	974	974
query77	638	276	272	272
query78	10136	9877	9749	9749
query79	2024	531	520	520
query80	1102	451	445	445
query81	525	227	228	227
query82	1268	100	92	92
query83	206	177	190	177
query84	263	87	91	87
query85	1409	271	267	267
query86	463	323	316	316
query87	3238	3170	3150	3150
query88	3927	2334	2354	2334
query89	488	421	387	387
query90	1973	189	195	189
query91	138	109	112	109
query92	62	53	55	53
query93	1990	513	498	498
query94	1164	199	201	199
query95	483	315	318	315
query96	581	269	267	267
query97	3216	3062	3037	3037
query98	245	222	213	213
query99	1212	880	844	844
Total cold run time: 276617 ms
Total hot run time: 170130 ms

doris-robot avatar May 30 '24 15:05 doris-robot

ClickBench: Total hot run time: 30.54 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c180e523bc696255a27dcfa48f028f1c299a52aa, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.05
query3	0.23	0.05	0.05
query4	1.67	0.09	0.08
query5	0.50	0.49	0.49
query6	1.12	0.72	0.72
query7	0.02	0.01	0.01
query8	0.06	0.04	0.04
query9	0.55	0.50	0.49
query10	0.56	0.56	0.54
query11	0.15	0.11	0.11
query12	0.15	0.12	0.12
query13	0.59	0.59	0.59
query14	0.77	0.79	0.78
query15	0.84	0.81	0.82
query16	0.37	0.37	0.37
query17	1.03	1.04	0.96
query18	0.23	0.24	0.25
query19	1.90	1.82	1.73
query20	0.01	0.02	0.02
query21	15.72	0.67	0.65
query22	3.58	7.63	1.91
query23	18.26	1.41	1.28
query24	2.08	0.21	0.21
query25	0.13	0.08	0.07
query26	0.27	0.17	0.16
query27	0.07	0.09	0.08
query28	13.26	1.01	1.07
query29	12.83	3.26	3.22
query30	0.24	0.06	0.06
query31	2.86	0.38	0.38
query32	3.30	0.47	0.47
query33	2.84	2.89	2.93
query34	16.96	4.42	4.51
query35	4.53	4.48	4.47
query36	0.66	0.46	0.46
query37	0.18	0.16	0.16
query38	0.16	0.14	0.16
query39	0.05	0.03	0.04
query40	0.16	0.14	0.15
query41	0.10	0.04	0.05
query42	0.05	0.04	0.05
query43	0.04	0.04	0.03
Total cold run time: 109.2 s
Total hot run time: 30.54 s

doris-robot avatar May 30 '24 15:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 36.30% (9231/25433) Line Coverage: 27.64% (75710/273901) Region Coverage: 26.86% (39198/145951) Branch Coverage: 23.61% (19896/84262) Coverage Report: http://coverage.selectdb-in.cc/coverage/c180e523bc696255a27dcfa48f028f1c299a52aa_c180e523bc696255a27dcfa48f028f1c299a52aa/report/index.html

doris-robot avatar May 30 '24 15:05 doris-robot

run buildall

mrhhsg avatar May 31 '24 12:05 mrhhsg

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 31 '24 12:05 github-actions[bot]

TPC-H: Total hot run time: 41235 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d59a37102575770a1555a29ba68e52d0731a8dc1, data reload: false

------ Round 1 ----------------------------------
q1	17610	4316	4282	4282
q2	2034	213	199	199
q3	10414	1286	1225	1225
q4	10198	762	835	762
q5	7513	2768	2728	2728
q6	229	134	135	134
q7	987	655	609	609
q8	9228	2148	2115	2115
q9	9441	6711	6715	6711
q10	9219	3858	4037	3858
q11	468	254	251	251
q12	552	240	233	233
q13	17332	3271	3243	3243
q14	272	223	245	223
q15	547	477	492	477
q16	497	410	413	410
q17	1017	704	706	704
q18	8278	7834	7895	7834
q19	6228	1246	1334	1246
q20	681	337	337	337
q21	5182	3317	4122	3317
q22	399	345	337	337
Total cold run time: 118326 ms
Total hot run time: 41235 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4781	4385	4463	4385
q2	366	277	261	261
q3	3180	2940	2966	2940
q4	1927	1695	1727	1695
q5	5310	5488	5545	5488
q6	227	128	132	128
q7	2168	1883	1813	1813
q8	3268	3353	3356	3353
q9	8767	8689	8667	8667
q10	4107	3887	3911	3887
q11	612	509	501	501
q12	791	626	596	596
q13	15880	3012	3162	3012
q14	322	286	255	255
q15	524	504	473	473
q16	494	449	432	432
q17	1832	1477	1497	1477
q18	8161	7868	7351	7351
q19	1796	1508	1611	1508
q20	3028	1783	1795	1783
q21	5109	4801	4707	4707
q22	622	530	527	527
Total cold run time: 73272 ms
Total hot run time: 55239 ms

doris-robot avatar May 31 '24 13:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 36.29% (9232/25441) Line Coverage: 27.64% (75714/273963) Region Coverage: 26.85% (39187/145971) Branch Coverage: 23.60% (19886/84270) Coverage Report: http://coverage.selectdb-in.cc/coverage/d59a37102575770a1555a29ba68e52d0731a8dc1_d59a37102575770a1555a29ba68e52d0731a8dc1/report/index.html

doris-robot avatar May 31 '24 13:05 doris-robot

TPC-DS: Total hot run time: 172168 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d59a37102575770a1555a29ba68e52d0731a8dc1, data reload: false

query1	898	392	375	375
query2	6457	2319	2447	2319
query3	6648	204	205	204
query4	19214	17239	17282	17239
query5	4154	454	452	452
query6	245	149	151	149
query7	4585	297	292	292
query8	331	278	295	278
query9	8503	2391	2379	2379
query10	458	301	277	277
query11	10505	10165	10137	10137
query12	132	93	86	86
query13	1647	356	358	356
query14	10319	7496	7550	7496
query15	242	189	184	184
query16	7824	266	291	266
query17	1696	523	529	523
query18	1950	269	263	263
query19	192	156	156	156
query20	98	89	83	83
query21	202	130	133	130
query22	4325	3977	3846	3846
query23	33672	33115	33095	33095
query24	11028	2862	2846	2846
query25	603	353	358	353
query26	1208	159	156	156
query27	2487	315	315	315
query28	6911	2088	2064	2064
query29	921	601	590	590
query30	283	151	153	151
query31	961	743	756	743
query32	93	52	53	52
query33	761	276	291	276
query34	937	475	466	466
query35	744	668	605	605
query36	1066	919	888	888
query37	146	72	68	68
query38	2954	2771	2756	2756
query39	857	794	773	773
query40	203	124	127	124
query41	59	54	53	53
query42	119	97	96	96
query43	608	562	562	562
query44	1247	738	739	738
query45	199	169	165	165
query46	1073	714	746	714
query47	1855	1771	1757	1757
query48	360	306	307	306
query49	1007	413	443	413
query50	779	386	372	372
query51	6769	6618	6581	6581
query52	108	93	96	93
query53	359	284	279	279
query54	876	445	437	437
query55	74	71	70	70
query56	272	253	261	253
query57	1120	1025	1005	1005
query58	263	245	252	245
query59	3572	3423	2987	2987
query60	299	284	290	284
query61	116	89	87	87
query62	660	435	462	435
query63	316	280	285	280
query64	8903	2185	1806	1806
query65	3168	3095	3130	3095
query66	944	335	321	321
query67	15326	15365	14726	14726
query68	4625	543	555	543
query69	586	403	374	374
query70	1164	1136	1121	1121
query71	427	273	284	273
query72	7136	4911	5505	4911
query73	758	318	326	318
query74	6103	5635	5690	5635
query75	3502	2629	2675	2629
query76	2769	925	892	892
query77	623	294	292	292
query78	10312	9923	9681	9681
query79	2238	513	508	508
query80	1421	448	462	448
query81	576	218	221	218
query82	738	101	107	101
query83	214	179	238	179
query84	267	83	88	83
query85	1374	271	278	271
query86	404	302	313	302
query87	3338	3113	3133	3113
query88	3820	2330	2350	2330
query89	490	382	379	379
query90	1827	186	188	186
query91	122	96	95	95
query92	65	47	48	47
query93	1877	510	497	497
query94	1157	184	183	183
query95	390	303	319	303
query96	592	263	267	263
query97	3151	2983	3075	2983
query98	239	218	204	204
query99	1233	861	835	835
Total cold run time: 270449 ms
Total hot run time: 172168 ms

doris-robot avatar May 31 '24 14:05 doris-robot

ClickBench: Total hot run time: 30.52 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d59a37102575770a1555a29ba68e52d0731a8dc1, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.04	0.04
query4	1.68	0.07	0.08
query5	0.50	0.48	0.50
query6	1.13	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.54	0.48	0.49
query10	0.55	0.56	0.53
query11	0.16	0.11	0.12
query12	0.14	0.12	0.11
query13	0.59	0.59	0.61
query14	0.77	0.80	0.79
query15	0.82	0.81	0.82
query16	0.37	0.37	0.36
query17	0.96	0.95	0.97
query18	0.21	0.24	0.24
query19	1.76	1.70	1.67
query20	0.02	0.01	0.01
query21	15.43	0.70	0.68
query22	4.36	7.54	1.83
query23	18.27	1.42	1.34
query24	1.80	0.22	0.22
query25	0.15	0.08	0.08
query26	0.26	0.17	0.17
query27	0.09	0.07	0.08
query28	13.32	1.01	1.00
query29	12.66	3.33	3.32
query30	0.24	0.05	0.05
query31	2.87	0.38	0.38
query32	3.30	0.47	0.47
query33	2.91	2.88	2.92
query34	17.20	4.46	4.40
query35	4.48	4.48	4.50
query36	0.70	0.49	0.48
query37	0.18	0.16	0.14
query38	0.15	0.14	0.14
query39	0.04	0.04	0.04
query40	0.16	0.16	0.15
query41	0.09	0.06	0.05
query42	0.06	0.04	0.04
query43	0.04	0.03	0.03
Total cold run time: 109.39 s
Total hot run time: 30.52 s

doris-robot avatar May 31 '24 14:05 doris-robot

run buildall

mrhhsg avatar May 31 '24 16:05 mrhhsg

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 31 '24 16:05 github-actions[bot]

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 31 '24 16:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 31 '24 16:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 36.28% (9234/25452) Line Coverage: 27.64% (75731/274028) Region Coverage: 26.85% (39204/146012) Branch Coverage: 23.60% (19895/84300) Coverage Report: http://coverage.selectdb-in.cc/coverage/ad35d201e34ca98fd7b7cabb0b89c9aa3b19de9d_ad35d201e34ca98fd7b7cabb0b89c9aa3b19de9d/report/index.html

doris-robot avatar May 31 '24 16:05 doris-robot

TPC-H: Total hot run time: 41143 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ad35d201e34ca98fd7b7cabb0b89c9aa3b19de9d, data reload: false

------ Round 1 ----------------------------------
q1	18331	5904	4273	4273
q2	2024	194	195	194
q3	10573	1128	1252	1128
q4	10314	838	843	838
q5	7514	2710	2851	2710
q6	226	132	136	132
q7	951	627	606	606
q8	9224	2134	2116	2116
q9	9287	6674	6767	6674
q10	9412	3976	3887	3887
q11	446	246	261	246
q12	487	224	235	224
q13	17313	3177	3238	3177
q14	283	232	223	223
q15	503	461	474	461
q16	493	378	388	378
q17	1003	685	714	685
q18	8432	7976	7733	7733
q19	6301	1496	1512	1496
q20	651	313	323	313
q21	5121	3992	3325	3325
q22	386	343	324	324
Total cold run time: 119275 ms
Total hot run time: 41143 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4511	4456	4413	4413
q2	390	271	271	271
q3	3108	2920	2915	2915
q4	2079	1655	1586	1586
q5	5342	5488	5521	5488
q6	218	125	123	123
q7	2162	1842	1802	1802
q8	3239	3356	3429	3356
q9	8705	8642	8654	8642
q10	4107	3851	3836	3836
q11	614	497	478	478
q12	805	617	589	589
q13	16851	3119	3140	3119
q14	299	254	269	254
q15	529	470	481	470
q16	486	442	424	424
q17	1826	1523	1500	1500
q18	8002	7744	7289	7289
q19	1780	1649	1558	1558
q20	3026	1809	1763	1763
q21	4799	4596	4677	4596
q22	600	522	526	522
Total cold run time: 73478 ms
Total hot run time: 54994 ms

doris-robot avatar May 31 '24 16:05 doris-robot

TPC-DS: Total hot run time: 170359 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ad35d201e34ca98fd7b7cabb0b89c9aa3b19de9d, data reload: false

query1	918	379	371	371
query2	6446	2452	2383	2383
query3	6645	199	205	199
query4	19274	17365	17462	17365
query5	4197	446	446	446
query6	269	157	155	155
query7	4576	313	297	297
query8	308	291	291	291
query9	8627	2384	2389	2384
query10	432	301	271	271
query11	10617	10025	10203	10025
query12	135	88	88	88
query13	1627	369	367	367
query14	9291	7619	6106	6106
query15	230	186	187	186
query16	7804	268	258	258
query17	1771	521	510	510
query18	1936	274	271	271
query19	197	153	153	153
query20	90	81	86	81
query21	212	126	129	126
query22	4097	3872	3903	3872
query23	33502	33076	33077	33076
query24	11180	2788	2834	2788
query25	628	354	361	354
query26	1650	156	154	154
query27	3036	317	326	317
query28	7301	2056	2063	2056
query29	1028	636	627	627
query30	292	150	150	150
query31	994	789	728	728
query32	89	51	55	51
query33	768	276	285	276
query34	985	494	475	475
query35	761	637	609	609
query36	1095	924	906	906
query37	154	70	68	68
query38	2903	2732	2762	2732
query39	846	780	779	779
query40	276	128	128	128
query41	53	53	49	49
query42	115	96	95	95
query43	565	558	542	542
query44	1212	731	748	731
query45	202	168	169	168
query46	1074	721	704	704
query47	1884	1761	1755	1755
query48	357	298	303	298
query49	1077	414	449	414
query50	781	386	371	371
query51	6838	6675	6543	6543
query52	101	90	91	90
query53	359	289	287	287
query54	910	446	437	437
query55	71	70	72	70
query56	277	254	259	254
query57	1133	1026	1041	1026
query58	246	241	240	240
query59	3460	3178	3143	3143
query60	302	274	273	273
query61	90	91	90	90
query62	627	449	491	449
query63	312	288	287	287
query64	9904	2214	1727	1727
query65	3167	3065	3109	3065
query66	1365	324	319	319
query67	15363	14799	14724	14724
query68	4612	543	545	543
query69	535	456	412	412
query70	1198	1122	1085	1085
query71	405	280	285	280
query72	7085	5674	4221	4221
query73	748	323	319	319
query74	6031	5601	5574	5574
query75	3351	2679	2702	2679
query76	2388	911	875	875
query77	483	353	297	297
query78	10475	9762	9892	9762
query79	2268	508	509	508
query80	1301	463	470	463
query81	551	213	217	213
query82	1283	99	104	99
query83	231	171	170	170
query84	252	84	80	80
query85	1546	274	275	274
query86	485	340	309	309
query87	3301	3164	3096	3096
query88	3886	2359	2351	2351
query89	476	395	381	381
query90	1840	191	192	191
query91	126	95	98	95
query92	62	48	48	48
query93	2162	523	510	510
query94	1317	190	187	187
query95	409	315	326	315
query96	589	273	268	268
query97	3250	3053	3053	3053
query98	264	217	235	217
query99	1297	854	865	854
Total cold run time: 273239 ms
Total hot run time: 170359 ms

doris-robot avatar May 31 '24 16:05 doris-robot