doris icon indicating copy to clipboard operation
doris copied to clipboard

[Refactor](Status) Refactor the scanner scheduler code make return error msg means

Open HappenLee opened this issue 1 year ago • 30 comments

Proposed changes

Before error msg:

Failed to submit scanner to scanner pool

After error msg:

Failed to submit scanner to scanner pool reason:Scan thread pool had shutdown|type 1

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

HappenLee avatar May 23 '24 09:05 HappenLee

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 23 '24 09:05 doris-robot

run buildall

HappenLee avatar May 23 '24 09:05 HappenLee

run buildall

HappenLee avatar May 23 '24 09:05 HappenLee

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 09:05 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 09:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.67% (9016/25278) Line Coverage: 27.31% (74543/272910) Region Coverage: 26.55% (38581/145323) Branch Coverage: 23.40% (19678/84098) Coverage Report: http://coverage.selectdb-in.cc/coverage/cadfd574f3737812e16a9f977881a2a323dfc047_cadfd574f3737812e16a9f977881a2a323dfc047/report/index.html

doris-robot avatar May 23 '24 09:05 doris-robot

TPC-H: Total hot run time: 41225 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cadfd574f3737812e16a9f977881a2a323dfc047, data reload: false

------ Round 1 ----------------------------------
q1	17646	4190	4200	4190
q2	2015	180	200	180
q3	10490	1209	1193	1193
q4	10193	888	849	849
q5	7456	2677	2674	2674
q6	220	129	133	129
q7	971	624	626	624
q8	9207	2120	2097	2097
q9	9441	6723	6791	6723
q10	9386	3976	3911	3911
q11	437	250	241	241
q12	443	217	240	217
q13	17575	3239	3261	3239
q14	286	234	223	223
q15	508	471	490	471
q16	474	383	385	383
q17	984	647	623	623
q18	8403	8035	7817	7817
q19	6157	1499	1531	1499
q20	627	329	326	326
q21	5270	3344	4046	3344
q22	343	272	281	272
Total cold run time: 118532 ms
Total hot run time: 41225 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4543	4405	4538	4405
q2	378	280	307	280
q3	3370	3087	3073	3073
q4	1945	1689	1650	1650
q5	5599	5653	5719	5653
q6	226	128	123	123
q7	2283	1973	1802	1802
q8	3304	3421	3388	3388
q9	8642	8684	8734	8684
q10	4039	3835	3681	3681
q11	568	485	490	485
q12	787	604	615	604
q13	16375	3141	3170	3141
q14	306	277	269	269
q15	504	490	473	473
q16	481	424	425	424
q17	1794	1528	1549	1528
q18	8070	7649	7442	7442
q19	1653	1493	1481	1481
q20	2018	1786	1805	1786
q21	14270	4795	4616	4616
q22	560	506	517	506
Total cold run time: 81715 ms
Total hot run time: 55494 ms

doris-robot avatar May 23 '24 10:05 doris-robot

TPC-DS: Total hot run time: 170856 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cadfd574f3737812e16a9f977881a2a323dfc047, data reload: false

query1	928	379	367	367
query2	6441	2403	2361	2361
query3	6649	202	202	202
query4	19343	17431	17274	17274
query5	4233	422	432	422
query6	241	159	157	157
query7	4578	291	281	281
query8	238	179	176	176
query9	8458	2473	2456	2456
query10	454	291	255	255
query11	10516	10220	10074	10074
query12	139	88	87	87
query13	1664	365	364	364
query14	9983	6028	7630	6028
query15	234	165	167	165
query16	7925	270	255	255
query17	1704	518	527	518
query18	2032	277	262	262
query19	196	150	145	145
query20	91	94	94	94
query21	193	126	126	126
query22	4276	4076	3915	3915
query23	33344	33008	32873	32873
query24	10516	2877	2826	2826
query25	576	342	352	342
query26	706	155	156	155
query27	2207	321	321	321
query28	5938	2082	2098	2082
query29	859	625	592	592
query30	243	170	173	170
query31	962	754	770	754
query32	93	50	53	50
query33	647	259	280	259
query34	875	466	475	466
query35	722	590	592	590
query36	1081	939	922	922
query37	106	68	70	68
query38	2874	2760	2731	2731
query39	846	780	774	774
query40	193	125	131	125
query41	46	45	44	44
query42	100	91	94	91
query43	565	540	533	533
query44	1050	713	730	713
query45	177	162	163	162
query46	1059	713	719	713
query47	1826	1763	1782	1763
query48	365	297	299	297
query49	845	404	373	373
query50	771	383	383	383
query51	6744	6669	6580	6580
query52	94	90	93	90
query53	342	275	280	275
query54	823	432	422	422
query55	74	73	71	71
query56	260	267	258	258
query57	1136	1012	1009	1009
query58	232	206	211	206
query59	3360	3349	3342	3342
query60	264	265	250	250
query61	88	87	87	87
query62	667	451	439	439
query63	307	278	283	278
query64	8473	2215	1694	1694
query65	3155	3078	3098	3078
query66	770	326	326	326
query67	15195	14701	14761	14701
query68	4561	524	523	523
query69	441	267	269	267
query70	1135	1109	1095	1095
query71	406	268	263	263
query72	7435	5391	5615	5391
query73	724	327	318	318
query74	6050	5550	5622	5550
query75	3325	2621	2624	2621
query76	2782	925	1026	925
query77	390	262	266	262
query78	10455	9898	9746	9746
query79	2485	513	519	513
query80	1147	470	457	457
query81	555	250	240	240
query82	946	105	97	97
query83	266	181	181	181
query84	256	91	95	91
query85	1283	286	260	260
query86	425	311	309	309
query87	3310	3156	3079	3079
query88	4151	2425	2396	2396
query89	481	386	382	382
query90	2049	186	188	186
query91	125	96	95	95
query92	58	52	48	48
query93	1961	509	503	503
query94	1270	182	189	182
query95	395	311	309	309
query96	583	261	261	261
query97	3184	2987	2988	2987
query98	251	224	219	219
query99	1175	858	838	838
Total cold run time: 266152 ms
Total hot run time: 170856 ms

doris-robot avatar May 23 '24 10:05 doris-robot

ClickBench: Total hot run time: 30.21 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cadfd574f3737812e16a9f977881a2a323dfc047, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.05
query3	0.22	0.04	0.04
query4	1.68	0.07	0.07
query5	0.49	0.49	0.49
query6	1.12	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.53	0.48	0.49
query10	0.54	0.55	0.54
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.60	0.58	0.59
query14	0.79	0.76	0.78
query15	0.83	0.81	0.82
query16	0.36	0.37	0.36
query17	0.95	0.98	1.03
query18	0.23	0.23	0.26
query19	1.80	1.72	1.77
query20	0.01	0.01	0.02
query21	15.44	0.73	0.70
query22	4.75	7.36	1.60
query23	18.31	1.36	1.25
query24	2.02	0.20	0.21
query25	0.17	0.09	0.08
query26	0.27	0.17	0.17
query27	0.08	0.08	0.07
query28	13.22	1.02	1.00
query29	13.16	3.33	3.28
query30	0.25	0.05	0.06
query31	2.84	0.38	0.37
query32	3.31	0.47	0.47
query33	2.89	2.83	2.90
query34	17.37	4.47	4.46
query35	4.49	4.51	4.59
query36	0.66	0.46	0.48
query37	0.18	0.17	0.16
query38	0.16	0.14	0.14
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.04	0.05
query42	0.05	0.04	0.05
query43	0.04	0.03	0.03
Total cold run time: 110.6 s
Total hot run time: 30.21 s

doris-robot avatar May 23 '24 10:05 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 23 '24 10:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 23 '24 10:05 github-actions[bot]

run buildall

yiguolei avatar May 23 '24 18:05 yiguolei

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 18:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.65% (9018/25293) Line Coverage: 27.31% (74564/273050) Region Coverage: 26.54% (38590/145425) Branch Coverage: 23.40% (19685/84132) Coverage Report: http://coverage.selectdb-in.cc/coverage/3cce710d4936a43914aca648f898b95850561b78_3cce710d4936a43914aca648f898b95850561b78/report/index.html

doris-robot avatar May 23 '24 18:05 doris-robot

TPC-H: Total hot run time: 41860 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3cce710d4936a43914aca648f898b95850561b78, data reload: false

------ Round 1 ----------------------------------
q1	17605	4333	4338	4333
q2	2017	199	193	193
q3	10457	1250	1225	1225
q4	10181	811	838	811
q5	7466	2709	2805	2709
q6	224	137	136	136
q7	943	617	615	615
q8	9243	2113	2109	2109
q9	10821	6687	6724	6687
q10	9619	3901	3823	3823
q11	436	239	231	231
q12	497	219	226	219
q13	17208	3163	3308	3163
q14	271	229	241	229
q15	513	461	471	461
q16	462	386	384	384
q17	974	681	777	681
q18	8284	7787	7852	7787
q19	4798	1559	1573	1559
q20	637	301	305	301
q21	5120	4020	3931	3931
q22	350	273	288	273
Total cold run time: 118126 ms
Total hot run time: 41860 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4524	4433	4509	4433
q2	368	283	278	278
q3	3194	2909	2907	2907
q4	1875	1558	1587	1558
q5	5433	5489	5443	5443
q6	221	125	128	125
q7	2160	1860	1844	1844
q8	3275	3393	3352	3352
q9	8561	8668	8638	8638
q10	3979	3748	3866	3748
q11	597	491	513	491
q12	793	633	607	607
q13	15990	3202	3139	3139
q14	291	259	279	259
q15	512	466	503	466
q16	477	457	429	429
q17	1825	1518	1468	1468
q18	7734	7796	7418	7418
q19	1674	1545	1480	1480
q20	2018	1816	1765	1765
q21	8959	4656	4696	4656
q22	571	485	479	479
Total cold run time: 75031 ms
Total hot run time: 54983 ms

doris-robot avatar May 23 '24 19:05 doris-robot

TPC-DS: Total hot run time: 170400 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3cce710d4936a43914aca648f898b95850561b78, data reload: false

query1	918	414	371	371
query2	6421	2433	2194	2194
query3	6642	213	210	210
query4	23089	17555	17381	17381
query5	4134	416	404	404
query6	241	154	159	154
query7	4589	294	292	292
query8	235	183	202	183
query9	8481	2356	2336	2336
query10	441	272	256	256
query11	10429	10108	10108	10108
query12	136	89	97	89
query13	1641	359	362	359
query14	9167	7600	7501	7501
query15	213	163	174	163
query16	7745	269	270	269
query17	1711	533	525	525
query18	1968	278	276	276
query19	213	159	157	157
query20	90	86	89	86
query21	194	128	127	127
query22	4203	4116	3920	3920
query23	34062	33070	33091	33070
query24	7284	2834	2853	2834
query25	570	350	355	350
query26	701	153	162	153
query27	2160	321	322	321
query28	5005	2027	2046	2027
query29	861	614	630	614
query30	247	175	173	173
query31	954	751	767	751
query32	91	52	53	52
query33	569	293	262	262
query34	867	469	465	465
query35	707	610	604	604
query36	1041	926	914	914
query37	103	72	70	70
query38	2904	2758	2775	2758
query39	829	781	780	780
query40	196	129	123	123
query41	45	43	44	43
query42	105	96	97	96
query43	587	580	543	543
query44	1045	722	737	722
query45	183	163	160	160
query46	1067	712	747	712
query47	1816	1749	1759	1749
query48	369	308	304	304
query49	856	421	381	381
query50	767	373	379	373
query51	6970	6845	6916	6845
query52	105	87	91	87
query53	352	284	285	284
query54	530	437	430	430
query55	74	71	72	71
query56	263	250	245	245
query57	1126	1062	1046	1046
query58	235	223	228	223
query59	3582	3266	3160	3160
query60	272	263	255	255
query61	92	90	123	90
query62	605	459	448	448
query63	316	280	281	280
query64	8444	2189	1746	1746
query65	3186	3085	3099	3085
query66	785	328	325	325
query67	15170	14619	14719	14619
query68	4562	544	531	531
query69	460	275	287	275
query70	1187	1134	1159	1134
query71	384	270	277	270
query72	7735	5395	2849	2849
query73	716	320	320	320
query74	6003	5657	5617	5617
query75	3324	2654	2656	2654
query76	2253	1076	968	968
query77	595	286	270	270
query78	10396	9875	9824	9824
query79	2060	524	513	513
query80	1167	462	439	439
query81	542	249	244	244
query82	669	98	95	95
query83	254	176	175	175
query84	246	91	89	89
query85	1662	322	322	322
query86	481	311	317	311
query87	3270	3132	3122	3122
query88	4239	2373	2352	2352
query89	492	393	380	380
query90	2040	193	190	190
query91	130	108	106	106
query92	59	52	52	52
query93	2681	519	499	499
query94	1296	197	192	192
query95	416	314	315	314
query96	594	263	266	263
query97	3125	3011	2959	2959
query98	253	217	217	217
query99	1120	850	874	850
Total cold run time: 265410 ms
Total hot run time: 170400 ms

doris-robot avatar May 23 '24 19:05 doris-robot

ClickBench: Total hot run time: 30.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3cce710d4936a43914aca648f898b95850561b78, data reload: false

query1	0.04	0.03	0.04
query2	0.08	0.03	0.04
query3	0.23	0.06	0.06
query4	1.65	0.08	0.07
query5	0.48	0.48	0.50
query6	1.14	0.72	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.53	0.49	0.49
query10	0.55	0.54	0.54
query11	0.15	0.11	0.11
query12	0.15	0.11	0.12
query13	0.59	0.58	0.59
query14	0.77	0.77	0.79
query15	0.84	0.81	0.81
query16	0.36	0.37	0.34
query17	1.02	0.96	1.03
query18	0.24	0.21	0.26
query19	1.82	1.72	1.70
query20	0.02	0.01	0.01
query21	15.44	0.70	0.68
query22	4.13	7.24	2.11
query23	18.32	1.36	1.33
query24	1.97	0.21	0.22
query25	0.15	0.08	0.07
query26	0.26	0.18	0.17
query27	0.08	0.07	0.07
query28	13.32	1.03	1.01
query29	12.88	3.31	3.30
query30	0.24	0.06	0.05
query31	2.87	0.39	0.39
query32	3.28	0.47	0.46
query33	2.83	2.88	2.96
query34	17.25	4.42	4.46
query35	4.52	4.49	4.61
query36	0.67	0.46	0.47
query37	0.17	0.15	0.16
query38	0.15	0.14	0.15
query39	0.04	0.03	0.03
query40	0.19	0.14	0.14
query41	0.09	0.05	0.04
query42	0.05	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 109.68 s
Total hot run time: 30.75 s

doris-robot avatar May 23 '24 19:05 doris-robot

run buildall

HappenLee avatar May 24 '24 07:05 HappenLee

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 24 '24 07:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.65% (9018/25296) Line Coverage: 27.31% (74581/273100) Region Coverage: 26.54% (38610/145453) Branch Coverage: 23.40% (19695/84152) Coverage Report: http://coverage.selectdb-in.cc/coverage/aa84738a42ab554bcff363bdc479e60489c55689_aa84738a42ab554bcff363bdc479e60489c55689/report/index.html

doris-robot avatar May 24 '24 08:05 doris-robot

TPC-H: Total hot run time: 41156 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit aa84738a42ab554bcff363bdc479e60489c55689, data reload: false

------ Round 1 ----------------------------------
q1	17602	4337	4264	4264
q2	2020	193	203	193
q3	10427	1238	1223	1223
q4	10175	760	796	760
q5	7485	2672	2802	2672
q6	224	135	132	132
q7	959	615	670	615
q8	9238	2129	2072	2072
q9	9524	6693	6745	6693
q10	9204	3867	3758	3758
q11	433	252	238	238
q12	464	227	224	224
q13	17210	3200	3228	3200
q14	267	229	223	223
q15	517	476	468	468
q16	482	390	388	388
q17	999	731	758	731
q18	8345	7805	7818	7805
q19	5496	1559	1554	1554
q20	627	325	334	325
q21	5144	3333	4074	3333
q22	356	285	296	285
Total cold run time: 117198 ms
Total hot run time: 41156 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4577	4388	4460	4388
q2	385	264	271	264
q3	3197	2858	2945	2858
q4	1902	1635	1595	1595
q5	5453	5484	5458	5458
q6	213	121	122	121
q7	2159	1841	1852	1841
q8	3200	3393	3375	3375
q9	8672	8652	8662	8652
q10	3979	3736	3796	3736
q11	588	506	501	501
q12	793	617	632	617
q13	16945	3129	3164	3129
q14	320	281	268	268
q15	538	493	492	492
q16	512	441	436	436
q17	1816	1515	1459	1459
q18	7697	7474	7564	7474
q19	1648	1581	1517	1517
q20	1957	1771	1788	1771
q21	4994	4827	4754	4754
q22	560	497	504	497
Total cold run time: 72105 ms
Total hot run time: 55203 ms

doris-robot avatar May 24 '24 08:05 doris-robot

TPC-DS: Total hot run time: 168667 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit aa84738a42ab554bcff363bdc479e60489c55689, data reload: false

query1	909	381	360	360
query2	6428	2341	2427	2341
query3	6651	204	208	204
query4	19303	17315	17284	17284
query5	4182	431	422	422
query6	246	156	153	153
query7	4583	293	291	291
query8	234	193	183	183
query9	8553	2394	2368	2368
query10	440	277	288	277
query11	10579	10025	10059	10025
query12	137	91	91	91
query13	1647	370	366	366
query14	9470	7309	6645	6645
query15	228	165	170	165
query16	7996	257	252	252
query17	1733	536	505	505
query18	2053	280	264	264
query19	205	154	152	152
query20	88	101	87	87
query21	194	130	132	130
query22	4370	3884	3887	3884
query23	33500	32927	32945	32927
query24	6606	2830	2799	2799
query25	522	358	357	357
query26	695	160	158	158
query27	1900	325	329	325
query28	3631	2092	2099	2092
query29	845	581	627	581
query30	220	172	174	172
query31	933	759	757	757
query32	93	52	52	52
query33	492	268	259	259
query34	852	477	480	477
query35	681	604	594	594
query36	1026	916	922	916
query37	107	74	70	70
query38	2840	2794	2831	2794
query39	842	790	786	786
query40	195	126	124	124
query41	45	44	44	44
query42	104	97	100	97
query43	580	539	547	539
query44	1053	741	760	741
query45	172	160	161	160
query46	1041	714	705	705
query47	1857	1749	1772	1749
query48	382	303	300	300
query49	762	405	392	392
query50	762	378	394	378
query51	6824	6605	6603	6603
query52	103	91	98	91
query53	347	289	285	285
query54	533	429	425	425
query55	74	75	75	75
query56	263	241	249	241
query57	1133	1015	1062	1015
query58	235	212	238	212
query59	3616	3110	3003	3003
query60	283	275	266	266
query61	91	94	100	94
query62	570	500	454	454
query63	306	279	274	274
query64	8412	2196	1756	1756
query65	3161	3078	3115	3078
query66	774	322	334	322
query67	15240	14590	14911	14590
query68	4573	535	545	535
query69	446	285	279	279
query70	1189	1153	1080	1080
query71	393	282	269	269
query72	7788	2830	2651	2651
query73	704	326	324	324
query74	6208	5638	5608	5608
query75	3398	2641	2613	2613
query76	2286	994	1019	994
query77	389	277	278	277
query78	10403	10279	9697	9697
query79	2316	525	524	524
query80	1807	456	452	452
query81	506	249	243	243
query82	673	95	101	95
query83	304	178	185	178
query84	259	91	92	91
query85	1341	321	310	310
query86	472	331	320	320
query87	3299	3100	3169	3100
query88	4093	2373	2371	2371
query89	485	391	389	389
query90	2076	192	193	192
query91	137	106	109	106
query92	59	49	49	49
query93	3949	511	512	511
query94	1224	192	193	192
query95	414	322	328	322
query96	592	271	263	263
query97	3251	3025	2995	2995
query98	239	226	218	218
query99	1200	855	841	841
Total cold run time: 261405 ms
Total hot run time: 168667 ms

doris-robot avatar May 24 '24 08:05 doris-robot

ClickBench: Total hot run time: 30.74 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit aa84738a42ab554bcff363bdc479e60489c55689, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.07	0.06
query4	1.68	0.10	0.10
query5	0.50	0.49	0.50
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.53	0.48	0.49
query10	0.55	0.54	0.54
query11	0.15	0.12	0.11
query12	0.14	0.12	0.12
query13	0.59	0.59	0.61
query14	0.78	0.79	0.77
query15	0.83	0.80	0.81
query16	0.35	0.36	0.36
query17	0.97	0.99	0.98
query18	0.20	0.26	0.25
query19	1.77	1.76	1.74
query20	0.01	0.01	0.01
query21	15.48	0.71	0.69
query22	5.08	6.16	2.03
query23	18.28	1.30	1.28
query24	1.80	0.28	0.20
query25	0.15	0.07	0.08
query26	0.26	0.16	0.16
query27	0.08	0.07	0.08
query28	13.33	1.02	0.99
query29	12.89	3.36	3.30
query30	0.24	0.05	0.06
query31	2.89	0.38	0.38
query32	3.30	0.47	0.46
query33	2.93	2.83	2.88
query34	17.07	4.41	4.45
query35	4.43	4.54	4.54
query36	0.68	0.47	0.46
query37	0.18	0.15	0.16
query38	0.16	0.14	0.15
query39	0.04	0.04	0.03
query40	0.16	0.16	0.14
query41	0.09	0.04	0.05
query42	0.06	0.04	0.05
query43	0.04	0.03	0.04
Total cold run time: 110.22 s
Total hot run time: 30.74 s

doris-robot avatar May 24 '24 08:05 doris-robot

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 24 '24 08:05 github-actions[bot]

run buildall

HappenLee avatar May 27 '24 02:05 HappenLee

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 27 '24 03:05 github-actions[bot]

TPC-H: Total hot run time: 41582 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 85d094d929021a4015849d18156334cc3ebaab08, data reload: false

------ Round 1 ----------------------------------
q1	17616	4406	4322	4322
q2	2020	197	192	192
q3	10452	1252	1218	1218
q4	10194	780	811	780
q5	7481	2730	2733	2730
q6	230	146	138	138
q7	954	603	633	603
q8	9222	2182	2130	2130
q9	9209	6716	6796	6716
q10	9205	3938	3926	3926
q11	447	255	242	242
q12	470	226	226	226
q13	17356	3278	3143	3143
q14	270	228	236	228
q15	541	483	477	477
q16	509	396	395	395
q17	1011	711	691	691
q18	8535	7925	7895	7895
q19	8268	1550	1557	1550
q20	656	326	330	326
q21	5209	3370	4145	3370
q22	344	285	284	284
Total cold run time: 120199 ms
Total hot run time: 41582 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4602	4385	4439	4385
q2	383	286	279	279
q3	3149	2900	2858	2858
q4	1983	1737	1773	1737
q5	5338	5461	5504	5461
q6	221	129	125	125
q7	2177	1818	1793	1793
q8	3289	3430	3377	3377
q9	8720	8686	8775	8686
q10	4085	3919	3767	3767
q11	578	472	467	467
q12	769	625	621	621
q13	16035	3171	3155	3155
q14	297	281	266	266
q15	528	489	476	476
q16	490	434	443	434
q17	1833	1524	1553	1524
q18	8320	7653	7661	7653
q19	1674	1608	1503	1503
q20	2004	1786	1800	1786
q21	9986	4891	4812	4812
q22	574	507	471	471
Total cold run time: 77035 ms
Total hot run time: 55636 ms

doris-robot avatar May 27 '24 04:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.75% (9008/25197) Line Coverage: 27.37% (74553/272379) Region Coverage: 26.58% (38570/145093) Branch Coverage: 23.45% (19671/83896) Coverage Report: http://coverage.selectdb-in.cc/coverage/85d094d929021a4015849d18156334cc3ebaab08_85d094d929021a4015849d18156334cc3ebaab08/report/index.html

doris-robot avatar May 27 '24 04:05 doris-robot

TPC-DS: Total hot run time: 170498 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 85d094d929021a4015849d18156334cc3ebaab08, data reload: false

query1	914	390	372	372
query2	6440	2292	2279	2279
query3	6643	209	207	207
query4	19737	17466	17439	17439
query5	4091	414	438	414
query6	246	165	155	155
query7	4577	308	308	308
query8	238	184	177	177
query9	8534	2454	2431	2431
query10	462	284	270	270
query11	10463	10201	10264	10201
query12	133	89	88	88
query13	1639	362	361	361
query14	9223	7510	7462	7462
query15	219	173	173	173
query16	7710	269	259	259
query17	1547	522	539	522
query18	1942	281	266	266
query19	222	157	159	157
query20	92	82	93	82
query21	198	130	126	126
query22	4414	4089	3964	3964
query23	33570	33122	32939	32939
query24	5652	2910	2817	2817
query25	469	376	361	361
query26	685	160	160	160
query27	1832	325	328	325
query28	3873	2138	2114	2114
query29	832	597	598	597
query30	246	174	176	174
query31	911	758	756	756
query32	61	55	53	53
query33	501	266	261	261
query34	846	498	473	473
query35	718	634	616	616
query36	1031	920	915	915
query37	113	74	75	74
query38	2876	2781	2770	2770
query39	836	789	796	789
query40	203	130	130	130
query41	48	46	47	46
query42	107	99	100	99
query43	582	539	530	530
query44	1055	742	755	742
query45	181	199	165	165
query46	1061	737	732	732
query47	1861	1780	1772	1772
query48	371	309	304	304
query49	764	376	383	376
query50	775	401	388	388
query51	6812	6626	6662	6626
query52	102	95	93	93
query53	357	299	287	287
query54	532	442	433	433
query55	76	73	74	73
query56	258	244	243	243
query57	1138	1032	1052	1032
query58	235	212	237	212
query59	3350	3093	3393	3093
query60	273	257	258	257
query61	89	89	104	89
query62	572	455	451	451
query63	313	288	281	281
query64	2553	1778	1744	1744
query65	3158	3101	3123	3101
query66	785	332	330	330
query67	15100	14839	14927	14839
query68	4592	548	555	548
query69	443	271	271	271
query70	1158	1106	1137	1106
query71	369	272	268	268
query72	7804	5193	2737	2737
query73	745	332	328	328
query74	6147	5789	5588	5588
query75	3302	2614	2656	2614
query76	2231	1011	984	984
query77	370	284	270	270
query78	10265	9825	9681	9681
query79	2168	511	527	511
query80	847	444	430	430
query81	524	254	250	250
query82	597	98	95	95
query83	248	168	170	168
query84	246	86	84	84
query85	885	274	264	264
query86	451	322	307	307
query87	3361	3075	3131	3075
query88	3975	2436	2448	2436
query89	490	396	384	384
query90	2084	199	200	199
query91	139	111	170	111
query92	61	49	56	49
query93	1810	525	514	514
query94	1139	198	191	191
query95	404	314	313	313
query96	602	274	275	274
query97	3217	3091	3018	3018
query98	254	211	220	211
query99	1173	844	866	844
Total cold run time: 249548 ms
Total hot run time: 170498 ms

doris-robot avatar May 27 '24 04:05 doris-robot

ClickBench: Total hot run time: 30.67 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 85d094d929021a4015849d18156334cc3ebaab08, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.04
query3	0.23	0.04	0.05
query4	1.68	0.08	0.07
query5	0.49	0.49	0.52
query6	1.14	0.72	0.72
query7	0.02	0.02	0.02
query8	0.05	0.05	0.05
query9	0.52	0.49	0.49
query10	0.56	0.55	0.55
query11	0.17	0.12	0.11
query12	0.15	0.12	0.13
query13	0.59	0.59	0.59
query14	0.76	0.79	0.79
query15	0.83	0.80	0.81
query16	0.37	0.34	0.35
query17	1.02	0.99	0.98
query18	0.24	0.24	0.25
query19	1.75	1.70	1.75
query20	0.01	0.01	0.01
query21	15.42	0.70	0.67
query22	4.63	6.78	2.01
query23	18.28	1.40	1.25
query24	1.40	0.30	0.31
query25	0.14	0.09	0.08
query26	0.27	0.17	0.17
query27	0.08	0.08	0.08
query28	13.28	1.02	1.00
query29	13.10	3.31	3.23
query30	0.24	0.06	0.05
query31	2.87	0.39	0.39
query32	3.28	0.47	0.46
query33	2.92	2.88	2.85
query34	17.22	4.53	4.40
query35	4.52	4.51	4.68
query36	0.63	0.46	0.47
query37	0.20	0.15	0.16
query38	0.16	0.14	0.15
query39	0.04	0.03	0.03
query40	0.17	0.14	0.15
query41	0.09	0.05	0.05
query42	0.05	0.05	0.04
query43	0.05	0.03	0.04
Total cold run time: 109.73 s
Total hot run time: 30.67 s

doris-robot avatar May 27 '24 04:05 doris-robot