doris icon indicating copy to clipboard operation
doris copied to clipboard

[opt](memory) BE process exceed memory limit will reject new Query execution

Open xinyiZzz opened this issue 1 year ago • 23 comments

Proposed changes

If enable_query_enforce_exec is false, BE process exceed memory limit will reject new Query execution

mysql [tpch]>select count(s_name), s_name from supplier group by s_name limit 10;
ERROR 1105 (HY000): errCode = 2, detailMessage = (10.16.10.8)[MEM_LIMIT_EXCEEDED] try exec_plan_fragment failed, queryId 261a942cbaf94e88-a14fb23aa77fb675, process memory used [ASAN]9.85 GB exceed limit 3.01 GB or sys available memory [ASAN]155.71 GB less than low water mark 1.60 GB

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

xinyiZzz avatar May 23 '24 04:05 xinyiZzz

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 23 '24 04:05 doris-robot

run buildall

xinyiZzz avatar May 23 '24 04:05 xinyiZzz

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 04:05 github-actions[bot]

TPC-H: Total hot run time: 42492 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, data reload: false

------ Round 1 ----------------------------------
q1	17604	5039	4343	4343
q2	2018	189	195	189
q3	10460	1198	1251	1198
q4	10188	888	812	812
q5	7487	2772	2773	2772
q6	218	135	135	135
q7	986	623	646	623
q8	9216	2195	2152	2152
q9	9275	6693	6754	6693
q10	9158	4043	3939	3939
q11	450	241	248	241
q12	468	247	243	243
q13	17232	3380	3212	3212
q14	266	226	227	226
q15	522	490	496	490
q16	527	419	403	403
q17	1030	784	712	712
q18	8766	8135	7897	7897
q19	7682	1603	1547	1547
q20	674	322	323	322
q21	5384	4060	4307	4060
q22	380	283	291	283
Total cold run time: 119991 ms
Total hot run time: 42492 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4595	4430	4380	4380
q2	401	275	280	275
q3	3236	2926	2920	2920
q4	2068	1766	1746	1746
q5	5376	5537	5536	5536
q6	211	129	131	129
q7	2279	1814	1886	1814
q8	3240	3428	3465	3428
q9	8715	8676	8822	8676
q10	4160	3894	3816	3816
q11	601	484	494	484
q12	760	589	599	589
q13	17174	3196	3225	3196
q14	303	287	267	267
q15	536	489	486	486
q16	517	460	453	453
q17	1930	1603	1544	1544
q18	8246	7736	7535	7535
q19	1696	1524	1603	1524
q20	2031	1798	1821	1798
q21	9591	4739	4898	4739
q22	582	488	498	488
Total cold run time: 78248 ms
Total hot run time: 55823 ms

doris-robot avatar May 23 '24 05:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.66% (9015/25277) Line Coverage: 27.31% (74530/272908) Region Coverage: 26.54% (38575/145323) Branch Coverage: 23.40% (19682/84100) Coverage Report: http://coverage.selectdb-in.cc/coverage/54818c957cfdaf468330ca8cd7094bca623438d1_54818c957cfdaf468330ca8cd7094bca623438d1/report/index.html

doris-robot avatar May 23 '24 06:05 doris-robot

TPC-DS: Total hot run time: 171942 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, data reload: false

query1	922	383	371	371
query2	6436	2278	2344	2278
query3	6646	206	205	205
query4	19146	17367	17303	17303
query5	4145	438	447	438
query6	249	170	158	158
query7	4590	299	297	297
query8	241	198	189	189
query9	8475	2355	2345	2345
query10	455	297	275	275
query11	10516	10148	10013	10013
query12	135	90	86	86
query13	1640	380	385	380
query14	10330	6974	6984	6974
query15	227	171	173	171
query16	7767	299	267	267
query17	1381	521	550	521
query18	1946	278	267	267
query19	203	154	151	151
query20	99	84	84	84
query21	197	132	133	132
query22	4120	3901	3921	3901
query23	33912	32956	33093	32956
query24	9104	2877	2860	2860
query25	586	360	387	360
query26	709	157	161	157
query27	2201	337	325	325
query28	5742	2068	2057	2057
query29	869	611	604	604
query30	224	173	173	173
query31	979	757	752	752
query32	92	52	54	52
query33	613	271	268	268
query34	883	480	473	473
query35	716	628	598	598
query36	1043	906	890	890
query37	110	68	73	68
query38	2873	2765	2777	2765
query39	878	792	784	784
query40	193	135	126	126
query41	46	45	40	40
query42	105	97	100	97
query43	588	562	553	553
query44	1114	748	762	748
query45	177	163	167	163
query46	1063	719	752	719
query47	1846	1767	1761	1761
query48	376	309	298	298
query49	833	382	408	382
query50	777	403	403	403
query51	6791	6784	6851	6784
query52	122	90	88	88
query53	361	293	296	293
query54	699	450	431	431
query55	76	75	73	73
query56	270	250	249	249
query57	1151	1064	1051	1051
query58	227	215	222	215
query59	3408	3363	3222	3222
query60	287	260	254	254
query61	89	89	90	89
query62	609	470	453	453
query63	317	288	324	288
query64	8479	2212	1758	1758
query65	3153	3100	3133	3100
query66	792	333	329	329
query67	15224	14961	14676	14676
query68	4538	555	565	555
query69	452	272	279	272
query70	1104	1063	1135	1063
query71	362	276	273	273
query72	7527	5653	4875	4875
query73	715	330	327	327
query74	6115	5613	5605	5605
query75	3324	2594	2612	2594
query76	2334	999	1008	999
query77	379	268	286	268
query78	10283	9860	9768	9768
query79	1926	529	527	527
query80	1148	456	460	456
query81	541	246	248	246
query82	622	100	102	100
query83	255	181	176	176
query84	256	91	90	90
query85	1650	313	266	266
query86	480	304	311	304
query87	3262	3142	3128	3128
query88	4238	2454	2429	2429
query89	486	404	395	395
query90	2013	189	191	189
query91	124	98	102	98
query92	66	47	48	47
query93	2442	526	513	513
query94	1296	188	189	188
query95	405	321	312	312
query96	594	291	270	270
query97	3160	2962	2986	2962
query98	246	228	215	215
query99	1221	841	864	841
Total cold run time: 264137 ms
Total hot run time: 171942 ms

doris-robot avatar May 23 '24 06:05 doris-robot

TPC-H: Total hot run time: 39933 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, data reload: false

------ Round 1 ----------------------------------
q1	18062	4441	4294	4294
q2	2595	191	202	191
q3	11139	1182	1157	1157
q4	10516	843	780	780
q5	7510	2814	2673	2673
q6	220	136	131	131
q7	953	601	602	601
q8	9310	2099	2097	2097
q9	8899	6467	6446	6446
q10	8916	3668	3680	3668
q11	449	244	227	227
q12	407	221	212	212
q13	17767	2963	2976	2963
q14	259	217	223	217
q15	515	459	463	459
q16	498	390	382	382
q17	956	707	664	664
q18	8027	7500	7459	7459
q19	4094	1533	1492	1492
q20	644	292	296	292
q21	4977	3793	3260	3260
q22	337	268	282	268
Total cold run time: 117050 ms
Total hot run time: 39933 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4314	4175	4175	4175
q2	364	253	263	253
q3	2932	2796	2781	2781
q4	1830	1600	1576	1576
q5	5183	5244	5257	5244
q6	212	124	123	123
q7	2076	1753	1742	1742
q8	3173	3319	3296	3296
q9	8348	8282	8287	8282
q10	3858	3688	3706	3688
q11	589	484	483	483
q12	766	620	579	579
q13	16441	2990	2987	2987
q14	295	279	253	253
q15	505	471	467	467
q16	479	418	424	418
q17	1784	1519	1449	1449
q18	7701	7484	7537	7484
q19	1655	1528	1528	1528
q20	1979	1769	1785	1769
q21	4850	4860	4715	4715
q22	588	496	479	479
Total cold run time: 69922 ms
Total hot run time: 53771 ms

doris-robot avatar May 23 '24 07:05 doris-robot

TPC-DS: Total hot run time: 169617 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, data reload: false

query1	912	383	370	370
query2	6465	2363	2245	2245
query3	6657	208	206	206
query4	20798	17320	17359	17320
query5	4223	417	414	414
query6	255	151	150	150
query7	4583	299	290	290
query8	238	187	183	183
query9	8452	2362	2325	2325
query10	450	276	255	255
query11	10564	10158	10013	10013
query12	131	87	92	87
query13	1634	376	369	369
query14	9255	6995	7398	6995
query15	213	167	169	167
query16	7827	260	258	258
query17	1849	521	513	513
query18	1959	285	279	279
query19	209	159	184	159
query20	92	87	82	82
query21	198	129	129	129
query22	4242	4054	3976	3976
query23	33640	33023	32968	32968
query24	11979	2797	2776	2776
query25	678	348	361	348
query26	1813	151	152	151
query27	3024	314	316	314
query28	7659	2064	2033	2033
query29	1136	600	591	591
query30	270	169	170	169
query31	981	745	765	745
query32	92	54	55	54
query33	759	270	277	270
query34	1006	471	481	471
query35	746	621	598	598
query36	1072	922	921	921
query37	282	75	75	75
query38	2876	2765	2783	2765
query39	866	803	787	787
query40	264	124	122	122
query41	49	50	43	43
query42	101	95	95	95
query43	581	574	529	529
query44	1191	736	746	736
query45	171	165	162	162
query46	1081	743	689	689
query47	1832	1792	1777	1777
query48	373	299	300	299
query49	1192	378	385	378
query50	789	388	382	382
query51	6938	6889	6757	6757
query52	105	92	92	92
query53	347	292	290	290
query54	987	435	425	425
query55	71	99	73	73
query56	251	237	250	237
query57	1150	1037	1035	1035
query58	232	225	203	203
query59	3604	3275	3142	3142
query60	277	254	251	251
query61	89	101	87	87
query62	662	464	456	456
query63	310	278	283	278
query64	9846	2179	1697	1697
query65	3205	3096	3121	3096
query66	1381	338	323	323
query67	15492	14921	14910	14910
query68	4621	554	545	545
query69	431	261	262	261
query70	1113	1145	1171	1145
query71	395	270	273	270
query72	7653	5196	2755	2755
query73	712	323	321	321
query74	5961	5560	5543	5543
query75	3357	2671	2642	2642
query76	2538	925	952	925
query77	406	261	263	261
query78	10313	9925	10014	9925
query79	2661	526	513	513
query80	1071	435	429	429
query81	522	244	245	244
query82	712	93	95	93
query83	265	166	169	166
query84	238	86	84	84
query85	1672	283	267	267
query86	512	297	303	297
query87	3291	3096	3101	3096
query88	4282	2439	2442	2439
query89	501	390	390	390
query90	1969	190	192	190
query91	125	97	97	97
query92	67	49	49	49
query93	1976	513	505	505
query94	1224	184	187	184
query95	403	315	309	309
query96	601	275	272	272
query97	3207	2959	3078	2959
query98	242	214	212	212
query99	1108	844	844	844
Total cold run time: 276805 ms
Total hot run time: 169617 ms

doris-robot avatar May 23 '24 07:05 doris-robot

ClickBench: Total hot run time: 30.14 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 54818c957cfdaf468330ca8cd7094bca623438d1, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.05
query3	0.23	0.05	0.05
query4	1.68	0.07	0.08
query5	0.50	0.48	0.52
query6	1.13	0.72	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.03
query9	0.54	0.50	0.49
query10	0.54	0.56	0.54
query11	0.16	0.10	0.11
query12	0.14	0.12	0.12
query13	0.59	0.58	0.60
query14	0.79	0.78	0.77
query15	0.83	0.80	0.80
query16	0.36	0.37	0.36
query17	1.01	0.99	1.01
query18	0.21	0.23	0.25
query19	1.89	1.68	1.63
query20	0.01	0.01	0.01
query21	15.63	0.67	0.64
query22	4.07	7.91	1.79
query23	18.26	1.33	1.18
query24	1.68	0.28	0.21
query25	0.14	0.09	0.09
query26	0.26	0.16	0.17
query27	0.08	0.08	0.07
query28	13.36	1.03	1.00
query29	13.17	3.27	3.24
query30	0.24	0.06	0.05
query31	2.87	0.38	0.38
query32	3.32	0.47	0.47
query33	2.87	2.90	2.90
query34	17.01	4.43	4.40
query35	4.53	4.50	4.47
query36	0.64	0.46	0.46
query37	0.18	0.15	0.16
query38	0.15	0.14	0.15
query39	0.05	0.03	0.04
query40	0.16	0.14	0.17
query41	0.08	0.05	0.04
query42	0.06	0.04	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.65 s
Total hot run time: 30.14 s

doris-robot avatar May 23 '24 07:05 doris-robot

run buildall

xinyiZzz avatar May 23 '24 15:05 xinyiZzz

run buildall

xinyiZzz avatar May 23 '24 15:05 xinyiZzz

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 15:05 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 15:05 github-actions[bot]

TPC-H: Total hot run time: 40367 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fb2c1069281b48727b59f1c2ff1b73d5e3da911c, data reload: false

------ Round 1 ----------------------------------
q1	17621	4507	4363	4363
q2	2020	192	191	191
q3	10584	1191	1260	1191
q4	10337	790	774	774
q5	7542	2739	2624	2624
q6	222	134	138	134
q7	961	603	606	603
q8	9315	2111	2144	2111
q9	9206	6642	6647	6642
q10	10004	3692	3744	3692
q11	474	242	234	234
q12	539	220	215	215
q13	17769	2988	3008	2988
q14	267	218	217	217
q15	523	471	476	471
q16	510	376	382	376
q17	990	767	652	652
q18	8160	7545	7579	7545
q19	5168	1504	1504	1504
q20	653	311	316	311
q21	5060	4052	3252	3252
q22	342	277	280	277
Total cold run time: 118267 ms
Total hot run time: 40367 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4373	4238	4253	4238
q2	364	268	276	268
q3	3014	2804	2722	2722
q4	1862	1636	1609	1609
q5	5308	5291	5320	5291
q6	212	126	128	126
q7	2165	1775	1702	1702
q8	3199	3357	3383	3357
q9	8425	8405	8416	8405
q10	3861	3714	3740	3714
q11	589	490	477	477
q12	779	586	581	581
q13	16337	2977	3009	2977
q14	295	242	267	242
q15	518	482	469	469
q16	477	413	415	413
q17	1798	1485	1464	1464
q18	7692	7607	7501	7501
q19	1703	1577	1585	1577
q20	1959	1787	1764	1764
q21	4774	4784	4753	4753
q22	565	483	507	483
Total cold run time: 70269 ms
Total hot run time: 54133 ms

doris-robot avatar May 23 '24 17:05 doris-robot

TPC-DS: Total hot run time: 170494 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fb2c1069281b48727b59f1c2ff1b73d5e3da911c, data reload: false

query1	907	378	380	378
query2	6452	2495	2367	2367
query3	6650	204	209	204
query4	20054	17457	17360	17360
query5	4162	427	409	409
query6	256	153	149	149
query7	4595	292	286	286
query8	240	183	199	183
query9	8540	2408	2381	2381
query10	462	276	269	269
query11	10680	10195	10197	10195
query12	130	88	88	88
query13	1641	356	361	356
query14	10076	7398	7397	7397
query15	235	181	171	171
query16	7885	255	253	253
query17	1871	515	509	509
query18	1943	271	268	268
query19	204	150	151	150
query20	93	84	86	84
query21	193	125	127	125
query22	4225	4048	3948	3948
query23	33808	33092	33081	33081
query24	11894	2859	2813	2813
query25	648	354	364	354
query26	1790	153	153	153
query27	2970	322	320	320
query28	7574	2086	2072	2072
query29	1065	617	590	590
query30	314	169	173	169
query31	976	770	733	733
query32	91	52	55	52
query33	763	263	259	259
query34	1018	472	475	472
query35	730	585	600	585
query36	1093	927	908	908
query37	180	70	78	70
query38	3006	2851	2801	2801
query39	831	790	796	790
query40	272	123	122	122
query41	44	46	42	42
query42	106	99	100	99
query43	584	564	531	531
query44	1200	746	756	746
query45	180	164	159	159
query46	1081	688	715	688
query47	1856	1779	1812	1779
query48	364	293	290	290
query49	1180	395	383	383
query50	762	399	387	387
query51	7010	6765	6862	6765
query52	106	88	93	88
query53	352	291	277	277
query54	986	427	421	421
query55	78	72	73	72
query56	286	232	244	232
query57	1145	1051	1077	1051
query58	227	211	203	203
query59	3315	3228	3417	3228
query60	273	247	250	247
query61	86	87	85	85
query62	655	453	460	453
query63	305	279	285	279
query64	9901	2213	1766	1766
query65	3165	3082	3136	3082
query66	1356	338	334	334
query67	15385	15010	15129	15010
query68	4686	531	537	531
query69	438	260	266	260
query70	1190	1127	1028	1028
query71	399	272	271	271
query72	7142	2721	2575	2575
query73	737	324	323	323
query74	6048	5736	5719	5719
query75	3338	2643	2617	2617
query76	2611	967	931	931
query77	408	265	262	262
query78	10313	10056	9754	9754
query79	2661	514	518	514
query80	1072	432	428	428
query81	518	242	245	242
query82	969	104	94	94
query83	267	172	171	171
query84	249	90	95	90
query85	1367	257	357	257
query86	444	312	289	289
query87	3364	3133	3134	3133
query88	4150	2365	2345	2345
query89	478	382	371	371
query90	1945	184	188	184
query91	120	97	95	95
query92	58	47	50	47
query93	1891	516	502	502
query94	1234	183	183	183
query95	393	304	303	303
query96	597	267	271	267
query97	3225	3075	3095	3075
query98	244	216	216	216
query99	1091	846	847	846
Total cold run time: 276152 ms
Total hot run time: 170494 ms

doris-robot avatar May 23 '24 17:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.65% (9018/25294) Line Coverage: 27.31% (74561/273065) Region Coverage: 26.53% (38586/145433) Branch Coverage: 23.39% (19682/84138) Coverage Report: http://coverage.selectdb-in.cc/coverage/fb2c1069281b48727b59f1c2ff1b73d5e3da911c_fb2c1069281b48727b59f1c2ff1b73d5e3da911c/report/index.html

doris-robot avatar May 23 '24 17:05 doris-robot

ClickBench: Total hot run time: 30.1 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fb2c1069281b48727b59f1c2ff1b73d5e3da911c, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.04
query4	1.68	0.07	0.07
query5	0.50	0.49	0.50
query6	1.13	0.73	0.72
query7	0.02	0.01	0.01
query8	0.04	0.04	0.04
query9	0.54	0.49	0.49
query10	0.54	0.54	0.54
query11	0.16	0.11	0.11
query12	0.15	0.13	0.12
query13	0.59	0.59	0.60
query14	0.76	0.78	0.77
query15	0.83	0.81	0.81
query16	0.38	0.35	0.35
query17	0.95	0.95	0.99
query18	0.20	0.24	0.25
query19	1.82	1.68	1.75
query20	0.02	0.01	0.01
query21	15.46	0.68	0.65
query22	4.24	7.95	1.53
query23	18.25	1.40	1.28
query24	2.02	0.21	0.20
query25	0.14	0.09	0.09
query26	0.25	0.16	0.16
query27	0.08	0.08	0.08
query28	13.25	1.03	0.99
query29	13.21	3.33	3.30
query30	0.24	0.06	0.05
query31	2.87	0.39	0.37
query32	3.26	0.48	0.47
query33	2.86	2.90	2.86
query34	17.06	4.44	4.40
query35	4.52	4.51	4.58
query36	0.65	0.47	0.46
query37	0.17	0.16	0.16
query38	0.16	0.14	0.14
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.05	0.05
query42	0.05	0.05	0.05
query43	0.04	0.03	0.04
Total cold run time: 109.74 s
Total hot run time: 30.1 s

doris-robot avatar May 23 '24 17:05 doris-robot

run buildall

xinyiZzz avatar May 24 '24 03:05 xinyiZzz

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 24 '24 03:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.66% (9019/25295) Line Coverage: 27.31% (74588/273087) Region Coverage: 26.54% (38609/145450) Branch Coverage: 23.40% (19691/84150) Coverage Report: http://coverage.selectdb-in.cc/coverage/315b52c04acff0b11639a3d22dc63b01cc34a5ea_315b52c04acff0b11639a3d22dc63b01cc34a5ea/report/index.html

doris-robot avatar May 24 '24 04:05 doris-robot

TPC-H: Total hot run time: 41252 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 315b52c04acff0b11639a3d22dc63b01cc34a5ea, data reload: false

------ Round 1 ----------------------------------
q1	17627	5046	4240	4240
q2	2028	197	192	192
q3	10443	1160	1171	1160
q4	10200	850	731	731
q5	7471	2864	2715	2715
q6	233	133	136	133
q7	974	634	633	633
q8	9236	2193	2131	2131
q9	9545	6740	6786	6740
q10	9577	3908	3860	3860
q11	456	243	247	243
q12	465	228	228	228
q13	17226	3266	3232	3232
q14	283	242	217	217
q15	512	477	489	477
q16	495	388	394	388
q17	1003	689	713	689
q18	8444	7854	7784	7784
q19	4495	1573	1518	1518
q20	625	323	320	320
q21	5248	4092	3348	3348
q22	372	285	273	273
Total cold run time: 116958 ms
Total hot run time: 41252 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4525	4446	4411	4411
q2	390	287	264	264
q3	3212	2937	2927	2927
q4	1917	1670	1665	1665
q5	5503	5517	5549	5517
q6	222	121	120	120
q7	2158	1870	1796	1796
q8	3268	3401	3399	3399
q9	8664	8734	8708	8708
q10	4015	3779	3829	3779
q11	583	498	487	487
q12	818	634	635	634
q13	15905	3196	3131	3131
q14	314	287	279	279
q15	528	489	511	489
q16	518	435	459	435
q17	1826	1546	1460	1460
q18	7859	7808	7605	7605
q19	2336	1549	1563	1549
q20	2002	1800	1801	1800
q21	4944	4848	4667	4667
q22	561	467	496	467
Total cold run time: 72068 ms
Total hot run time: 55589 ms

doris-robot avatar May 24 '24 04:05 doris-robot

TPC-DS: Total hot run time: 171132 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 315b52c04acff0b11639a3d22dc63b01cc34a5ea, data reload: false

query1	912	381	384	381
query2	6451	2421	2295	2295
query3	6636	205	211	205
query4	19226	17338	17248	17248
query5	4158	428	421	421
query6	246	162	154	154
query7	4589	299	299	299
query8	238	191	186	186
query9	8567	2405	2391	2391
query10	456	294	271	271
query11	10576	10107	10049	10049
query12	128	99	88	88
query13	1629	366	364	364
query14	9934	7447	6019	6019
query15	208	167	167	167
query16	7753	268	255	255
query17	1492	518	509	509
query18	1902	270	271	270
query19	186	151	153	151
query20	93	84	84	84
query21	193	157	129	129
query22	4193	3919	3897	3897
query23	33475	33058	33256	33058
query24	6852	2798	2904	2798
query25	468	376	376	376
query26	694	159	161	159
query27	1926	337	328	328
query28	3871	2084	2083	2083
query29	827	602	604	602
query30	258	181	177	177
query31	931	772	725	725
query32	65	54	54	54
query33	495	266	260	260
query34	843	486	496	486
query35	702	624	613	613
query36	1020	919	921	919
query37	137	71	70	70
query38	2906	2751	2742	2742
query39	871	773	798	773
query40	204	126	119	119
query41	46	45	43	43
query42	106	100	102	100
query43	603	574	540	540
query44	1101	742	764	742
query45	178	160	165	160
query46	1059	711	708	708
query47	1846	1753	1771	1753
query48	371	297	290	290
query49	775	383	386	383
query50	769	388	392	388
query51	6928	6726	6787	6726
query52	107	94	89	89
query53	361	290	288	288
query54	546	444	427	427
query55	76	73	74	73
query56	292	240	252	240
query57	1142	1084	1059	1059
query58	225	215	218	215
query59	3533	3083	3180	3083
query60	280	258	250	250
query61	85	90	86	86
query62	561	469	466	466
query63	316	285	290	285
query64	2554	1812	1736	1736
query65	3177	3081	3133	3081
query66	783	329	322	322
query67	15066	14751	14636	14636
query68	4552	545	548	545
query69	436	263	269	263
query70	1186	1159	1133	1133
query71	390	278	278	278
query72	7227	5490	5627	5490
query73	717	321	317	317
query74	6063	5606	5588	5588
query75	3291	2673	2626	2626
query76	2244	1012	990	990
query77	389	270	268	268
query78	10273	9827	9693	9693
query79	2586	529	514	514
query80	1016	446	432	432
query81	529	250	241	241
query82	737	99	96	96
query83	265	177	177	177
query84	252	86	83	83
query85	1200	292	259	259
query86	476	310	304	304
query87	3276	3150	3060	3060
query88	3988	2351	2361	2351
query89	476	393	401	393
query90	2067	192	193	192
query91	133	108	176	108
query92	65	48	48	48
query93	2025	523	519	519
query94	1122	187	185	185
query95	403	315	317	315
query96	602	267	265	265
query97	3172	3025	3005	3005
query98	250	224	208	208
query99	1160	842	846	842
Total cold run time: 251765 ms
Total hot run time: 171132 ms

doris-robot avatar May 24 '24 04:05 doris-robot

ClickBench: Total hot run time: 30.73 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 315b52c04acff0b11639a3d22dc63b01cc34a5ea, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.04	0.04
query3	0.24	0.05	0.06
query4	1.66	0.09	0.10
query5	0.50	0.51	0.50
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.54	0.50	0.50
query10	0.54	0.55	0.56
query11	0.14	0.11	0.11
query12	0.15	0.12	0.12
query13	0.60	0.58	0.60
query14	0.78	0.79	0.78
query15	0.83	0.80	0.81
query16	0.36	0.36	0.37
query17	1.04	1.01	0.95
query18	0.22	0.24	0.24
query19	1.86	1.79	1.76
query20	0.02	0.01	0.01
query21	15.60	0.69	0.67
query22	4.30	6.69	1.91
query23	18.31	1.45	1.26
query24	1.99	0.24	0.19
query25	0.14	0.08	0.07
query26	0.26	0.17	0.16
query27	0.08	0.07	0.08
query28	13.28	1.00	1.00
query29	13.24	3.47	3.41
query30	0.24	0.06	0.05
query31	2.88	0.38	0.38
query32	3.28	0.47	0.47
query33	2.87	2.85	2.93
query34	16.95	4.43	4.46
query35	4.50	4.49	4.58
query36	0.68	0.47	0.48
query37	0.17	0.15	0.16
query38	0.15	0.14	0.14
query39	0.04	0.03	0.03
query40	0.16	0.14	0.15
query41	0.09	0.06	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 110.12 s
Total hot run time: 30.73 s

doris-robot avatar May 24 '24 05:05 doris-robot

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag!

github-actions[bot] avatar Nov 21 '24 00:11 github-actions[bot]