doris icon indicating copy to clipboard operation
doris copied to clipboard

[feature](Nereids) Support cache tablets aggregate result (fe)

Open 924060929 opened this issue 1 year ago • 35 comments

Proposed changes

support cache tablets aggregate result

for example

SQL 1:

select key, sum(value)
from tbl
where dt between '2024-08-01' and '2024-08-10'
group by key

SQL 2:

select key, sum(value)
from tbl
where dt between '2024-08-5' and '2024-08-15'
group by key

SQL 1 will update the tablets aggregate result which partition between '2024-08-01' and '2024-08-10'. Then SQL 2 will reuse the tablets aggregate which partition between '2024-08-05' and '2024-08-10', and compute aggregate which partition between '2024-08-11' and '2024-08-15'

We only support simple aggregate which not contains join with runtime filter, at present.

How to use

set enable_query_cache=true;

924060929 avatar Aug 21 '24 02:08 924060929

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Aug 21 '24 02:08 doris-robot

run buildall

924060929 avatar Aug 21 '24 03:08 924060929

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 21 '24 03:08 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 21 '24 03:08 github-actions[bot]

TPC-H: Total hot run time: 38724 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ee1b17c954369019b91fd5a9c0dc975d58546b4a, data reload: false

------ Round 1 ----------------------------------
q1	18176	5155	4539	4539
q2	2557	207	218	207
q3	12265	1141	1130	1130
q4	11165	796	741	741
q5	8128	2928	2769	2769
q6	280	158	167	158
q7	1017	662	658	658
q8	9392	2088	2108	2088
q9	7388	6582	6596	6582
q10	7086	2211	2247	2211
q11	509	273	271	271
q12	441	269	268	268
q13	17799	3020	2993	2993
q14	306	264	265	264
q15	572	504	527	504
q16	544	407	411	407
q17	994	706	782	706
q18	7561	6985	6865	6865
q19	5623	1069	1061	1061
q20	705	354	332	332
q21	3855	2995	2952	2952
q22	1123	1028	1018	1018
Total cold run time: 117486 ms
Total hot run time: 38724 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4525	4252	4265	4252
q2	403	307	290	290
q3	2892	2628	2643	2628
q4	1961	1649	1687	1649
q5	5413	5417	5425	5417
q6	234	144	146	144
q7	2063	1724	1715	1715
q8	3256	3349	3373	3349
q9	8499	8400	8338	8338
q10	3390	3206	3197	3197
q11	613	526	527	526
q12	817	624	625	624
q13	17671	3018	3031	3018
q14	337	296	320	296
q15	570	518	539	518
q16	527	451	457	451
q17	1804	1540	1484	1484
q18	7732	7558	7355	7355
q19	1722	1728	1617	1617
q20	2045	1845	1812	1812
q21	8042	5216	5035	5035
q22	1142	1042	1051	1042
Total cold run time: 75658 ms
Total hot run time: 54757 ms

doris-robot avatar Aug 21 '24 04:08 doris-robot

TPC-DS: Total hot run time: 191732 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ee1b17c954369019b91fd5a9c0dc975d58546b4a, data reload: false

query1	986	403	388	388
query2	6730	1983	1973	1973
query3	6691	234	248	234
query4	31257	23328	23237	23237
query5	4402	726	725	725
query6	316	214	209	209
query7	4615	331	327	327
query8	481	434	449	434
query9	8610	2517	2502	2502
query10	518	355	350	350
query11	18198	15078	15111	15078
query12	188	142	137	137
query13	1731	456	473	456
query14	9688	7219	6818	6818
query15	306	195	188	188
query16	8116	498	509	498
query17	1597	619	599	599
query18	2186	351	338	338
query19	350	174	171	171
query20	142	135	136	135
query21	254	140	142	140
query22	4288	3964	3937	3937
query23	34226	33465	33361	33361
query24	11102	2897	2933	2897
query25	644	425	419	419
query26	1180	181	181	181
query27	2415	306	304	304
query28	7280	2117	2115	2115
query29	857	449	442	442
query30	337	185	185	185
query31	1046	815	836	815
query32	129	83	89	83
query33	809	354	337	337
query34	910	502	515	502
query35	893	766	758	758
query36	1130	939	930	930
query37	178	103	105	103
query38	4061	3887	3896	3887
query39	1517	1492	1494	1492
query40	238	155	154	154
query41	159	138	139	138
query42	135	119	123	119
query43	548	497	515	497
query44	1309	792	800	792
query45	232	201	198	198
query46	1122	787	761	761
query47	1913	1804	1841	1804
query48	403	343	333	333
query49	1253	574	572	572
query50	857	462	459	459
query51	7221	7110	7129	7110
query52	121	111	111	111
query53	297	230	229	229
query54	946	507	504	504
query55	91	90	89	89
query56	330	338	321	321
query57	1208	1142	1121	1121
query58	313	300	328	300
query59	3073	2747	2864	2747
query60	354	324	337	324
query61	153	148	148	148
query62	875	687	699	687
query63	258	227	225	225
query64	5299	2396	1835	1835
query65	3222	3179	3200	3179
query66	1155	726	663	663
query67	15831	14922	14891	14891
query68	6472	590	580	580
query69	687	427	353	353
query70	1228	1156	1170	1156
query71	565	313	317	313
query72	7650	2327	2104	2104
query73	856	358	356	356
query74	9118	8939	8808	8808
query75	4957	2758	2779	2758
query76	4750	1049	988	988
query77	895	480	434	434
query78	10885	9749	12558	9749
query79	7668	570	563	563
query80	986	618	613	613
query81	617	261	268	261
query82	367	166	167	166
query83	386	217	212	212
query84	296	97	98	97
query85	828	370	353	353
query86	482	328	311	311
query87	4592	4246	4290	4246
query88	3700	2559	2508	2508
query89	429	337	329	329
query90	2032	243	275	243
query91	175	131	127	127
query92	102	81	76	76
query93	1196	568	559	559
query94	862	332	330	330
query95	402	297	303	297
query96	596	290	288	288
query97	3288	3029	3077	3029
query98	254	234	232	232
query99	1709	1336	1297	1297
Total cold run time: 308310 ms
Total hot run time: 191732 ms

doris-robot avatar Aug 21 '24 04:08 doris-robot

ClickBench: Total hot run time: 31.85 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ee1b17c954369019b91fd5a9c0dc975d58546b4a, data reload: false

query1	0.05	0.05	0.04
query2	0.09	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.08	0.07
query5	0.51	0.50	0.51
query6	1.14	0.73	0.74
query7	0.02	0.01	0.01
query8	0.05	0.05	0.05
query9	0.57	0.50	0.51
query10	0.55	0.56	0.55
query11	0.16	0.12	0.12
query12	0.16	0.14	0.13
query13	0.60	0.60	0.59
query14	0.76	0.79	0.81
query15	0.89	0.82	0.82
query16	0.37	0.38	0.36
query17	0.98	0.99	1.01
query18	0.22	0.21	0.20
query19	1.79	1.73	1.79
query20	0.01	0.01	0.02
query21	15.39	0.66	0.66
query22	4.16	7.05	2.46
query23	18.28	1.42	1.34
query24	2.09	0.23	0.21
query25	0.17	0.09	0.09
query26	0.28	0.18	0.17
query27	0.09	0.09	0.08
query28	13.29	1.03	1.02
query29	12.71	3.39	3.41
query30	0.44	0.25	0.24
query31	2.81	0.41	0.40
query32	3.24	0.48	0.49
query33	2.98	2.99	2.99
query34	17.27	4.34	4.36
query35	4.41	4.46	4.52
query36	0.68	0.49	0.48
query37	0.22	0.18	0.19
query38	0.18	0.17	0.17
query39	0.06	0.06	0.06
query40	0.19	0.15	0.16
query41	0.12	0.07	0.07
query42	0.08	0.07	0.06
query43	0.07	0.07	0.07
Total cold run time: 110.03 s
Total hot run time: 31.85 s

doris-robot avatar Aug 21 '24 04:08 doris-robot

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 26 '24 13:08 github-actions[bot]

run buildall

924060929 avatar Aug 26 '24 13:08 924060929

run buildall

924060929 avatar Aug 26 '24 13:08 924060929

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 26 '24 13:08 github-actions[bot]

run buildall

924060929 avatar Aug 26 '24 14:08 924060929

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 26 '24 14:08 github-actions[bot]

run buildall

924060929 avatar Aug 26 '24 14:08 924060929

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 26 '24 14:08 github-actions[bot]

TPC-H: Total hot run time: 38237 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2df5fe12ff4242d1cd49feead737b046bd5a0dc8, data reload: false

------ Round 1 ----------------------------------
q1	18066	4494	4368	4368
q2	2027	195	185	185
q3	11944	989	1151	989
q4	10489	733	745	733
q5	7791	2876	2857	2857
q6	226	138	137	137
q7	958	622	604	604
q8	9338	2093	2090	2090
q9	7224	6544	6572	6544
q10	7005	2173	2211	2173
q11	465	241	241	241
q12	394	230	231	230
q13	17756	3083	3031	3031
q14	295	244	239	239
q15	513	488	480	480
q16	491	393	392	392
q17	1006	771	731	731
q18	7554	6859	6942	6859
q19	1391	996	981	981
q20	681	333	345	333
q21	4050	3260	3004	3004
q22	1128	1036	1059	1036
Total cold run time: 110792 ms
Total hot run time: 38237 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4349	4316	4285	4285
q2	373	275	269	269
q3	2927	2663	2636	2636
q4	1965	1684	1694	1684
q5	5687	5728	5825	5728
q6	228	137	140	137
q7	2213	1843	1859	1843
q8	3290	3527	3540	3527
q9	8902	8900	8847	8847
q10	3597	3415	3387	3387
q11	612	504	520	504
q12	828	652	650	650
q13	14593	3151	3259	3151
q14	316	302	282	282
q15	536	509	486	486
q16	490	453	444	444
q17	1830	1520	1531	1520
q18	8187	7788	7908	7788
q19	1747	1444	1679	1444
q20	2157	1901	1868	1868
q21	5681	5549	5621	5549
q22	1146	1075	1069	1069
Total cold run time: 71654 ms
Total hot run time: 57098 ms

doris-robot avatar Aug 26 '24 15:08 doris-robot

TPC-DS: Total hot run time: 191640 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2df5fe12ff4242d1cd49feead737b046bd5a0dc8, data reload: false

query1	1271	868	886	868
query2	6349	1948	1880	1880
query3	10731	4171	4121	4121
query4	60094	26757	23131	23131
query5	5323	493	485	485
query6	413	160	172	160
query7	5763	305	301	301
query8	292	211	211	211
query9	8864	2498	2474	2474
query10	504	289	250	250
query11	18299	14977	15270	14977
query12	163	103	104	103
query13	1575	393	397	393
query14	10859	7344	7031	7031
query15	232	178	173	173
query16	7540	467	481	467
query17	1110	591	611	591
query18	2027	322	308	308
query19	310	159	156	156
query20	125	117	114	114
query21	212	105	103	103
query22	4666	4477	4459	4459
query23	34760	33440	33490	33440
query24	5951	2868	2832	2832
query25	559	403	401	401
query26	692	159	160	159
query27	1788	281	279	279
query28	3709	2062	2045	2045
query29	704	425	426	425
query30	240	162	157	157
query31	924	780	816	780
query32	86	55	51	51
query33	454	283	267	267
query34	842	470	474	470
query35	846	707	710	707
query36	1098	953	920	920
query37	145	83	81	81
query38	3974	3964	3951	3951
query39	1441	1403	1419	1403
query40	195	115	110	110
query41	47	46	45	45
query42	120	97	97	97
query43	504	468	462	462
query44	1095	738	735	735
query45	200	175	170	170
query46	1088	720	741	720
query47	1906	1790	1825	1790
query48	377	301	296	296
query49	784	422	435	422
query50	825	413	407	407
query51	7197	7035	7125	7035
query52	96	88	90	88
query53	251	176	178	176
query54	547	445	445	445
query55	77	74	83	74
query56	264	252	246	246
query57	1203	1100	1049	1049
query58	218	218	224	218
query59	3027	2715	2727	2715
query60	287	271	268	268
query61	107	101	103	101
query62	768	669	635	635
query63	213	179	182	179
query64	4222	2248	1707	1707
query65	3179	3182	3106	3106
query66	671	329	326	326
query67	15624	15316	15453	15316
query68	3032	556	558	556
query69	391	272	272	272
query70	1120	1107	1123	1107
query71	372	271	267	267
query72	2727	2074	2133	2074
query73	715	324	323	323
query74	9154	8708	8810	8708
query75	3363	2702	2725	2702
query76	1449	950	1023	950
query77	532	312	334	312
query78	9539	9183	9064	9064
query79	1029	540	533	533
query80	712	520	490	490
query81	508	227	229	227
query82	297	136	136	136
query83	171	149	150	149
query84	259	81	77	77
query85	676	284	290	284
query86	307	274	302	274
query87	4402	4427	4274	4274
query88	3043	2285	2307	2285
query89	373	288	287	287
query90	1942	196	193	193
query91	122	99	97	97
query92	62	52	54	52
query93	1046	536	537	536
query94	731	297	300	297
query95	361	332	261	261
query96	583	262	272	262
query97	3231	3092	3070	3070
query98	220	209	208	208
query99	1512	1278	1251	1251
Total cold run time: 304008 ms
Total hot run time: 191640 ms

doris-robot avatar Aug 26 '24 16:08 doris-robot

ClickBench: Total hot run time: 31.05 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2df5fe12ff4242d1cd49feead737b046bd5a0dc8, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.06	0.05
query4	1.66	0.09	0.08
query5	0.51	0.52	0.54
query6	1.13	0.73	0.73
query7	0.01	0.01	0.01
query8	0.06	0.05	0.05
query9	0.55	0.50	0.49
query10	0.54	0.55	0.54
query11	0.15	0.12	0.12
query12	0.15	0.12	0.12
query13	0.62	0.59	0.57
query14	0.76	0.80	0.79
query15	0.85	0.81	0.82
query16	0.37	0.38	0.39
query17	1.05	1.06	1.05
query18	0.22	0.21	0.21
query19	1.90	1.88	1.78
query20	0.02	0.01	0.01
query21	15.40	0.67	0.67
query22	4.30	7.48	1.87
query23	18.29	1.39	1.33
query24	2.13	0.23	0.22
query25	0.15	0.08	0.08
query26	0.26	0.19	0.19
query27	0.08	0.07	0.08
query28	13.28	1.02	1.00
query29	12.64	3.35	3.33
query30	0.26	0.06	0.05
query31	2.85	0.41	0.41
query32	3.24	0.48	0.48
query33	3.00	3.00	3.05
query34	17.00	4.40	4.48
query35	4.49	4.47	4.49
query36	0.66	0.49	0.48
query37	0.19	0.16	0.16
query38	0.15	0.15	0.16
query39	0.04	0.03	0.03
query40	0.16	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.67 s
Total hot run time: 31.05 s

doris-robot avatar Aug 26 '24 16:08 doris-robot

run buildall

924060929 avatar Aug 27 '24 04:08 924060929

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 27 '24 04:08 github-actions[bot]

TPC-H: Total hot run time: 38703 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bcd32caca49e571e8d02567dd11536b4459cba10, data reload: false

------ Round 1 ----------------------------------
q1	18240	4640	4478	4478
q2	2549	179	204	179
q3	11107	1160	1138	1138
q4	10303	727	811	727
q5	8352	2985	2892	2892
q6	243	147	162	147
q7	1009	654	621	621
q8	9507	2095	2114	2095
q9	7026	6607	6603	6603
q10	7010	2251	2235	2235
q11	461	242	252	242
q12	409	230	231	230
q13	19012	3042	3020	3020
q14	287	240	237	237
q15	523	488	504	488
q16	484	404	386	386
q17	1004	666	670	666
q18	7573	6892	6847	6847
q19	1403	1128	1058	1058
q20	694	348	341	341
q21	3988	3120	3055	3055
q22	1160	1020	1018	1018
Total cold run time: 112344 ms
Total hot run time: 38703 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4432	4375	4302	4302
q2	373	278	270	270
q3	2924	2646	2726	2646
q4	1944	1663	1668	1663
q5	5397	5461	5459	5459
q6	229	137	137	137
q7	2146	1725	1760	1725
q8	3235	3416	3414	3414
q9	8518	8439	8432	8432
q10	3473	3211	3194	3194
q11	581	485	495	485
q12	816	618	617	617
q13	11970	3042	3114	3042
q14	318	292	269	269
q15	527	475	480	475
q16	484	432	412	412
q17	1793	1509	1478	1478
q18	7851	7415	7475	7415
q19	1688	1675	1574	1574
q20	2035	1830	1805	1805
q21	5421	5266	5220	5220
q22	1127	1087	1051	1051
Total cold run time: 67282 ms
Total hot run time: 55085 ms

doris-robot avatar Aug 27 '24 05:08 doris-robot

TPC-DS: Total hot run time: 186180 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bcd32caca49e571e8d02567dd11536b4459cba10, data reload: false

query1	917	380	365	365
query2	6474	1979	1779	1779
query3	6641	214	223	214
query4	34214	23179	23420	23179
query5	4161	516	495	495
query6	261	163	179	163
query7	4568	293	290	290
query8	264	213	206	206
query9	8446	2526	2501	2501
query10	442	266	255	255
query11	17822	14943	14893	14893
query12	151	104	97	97
query13	1617	388	377	377
query14	9985	7267	6638	6638
query15	233	173	180	173
query16	7748	462	477	462
query17	1594	597	565	565
query18	1510	302	296	296
query19	210	151	155	151
query20	122	111	111	111
query21	216	104	127	104
query22	4583	4081	4037	4037
query23	34127	33427	33566	33427
query24	11076	2884	2880	2880
query25	616	392	407	392
query26	1299	158	159	158
query27	2761	280	276	276
query28	7407	2071	2065	2065
query29	818	418	404	404
query30	309	159	150	150
query31	985	795	750	750
query32	97	55	56	55
query33	768	291	302	291
query34	961	475	481	475
query35	856	767	692	692
query36	1091	928	950	928
query37	142	82	87	82
query38	4008	3733	3852	3733
query39	1455	1399	1400	1399
query40	273	120	117	117
query41	50	46	47	46
query42	120	98	101	98
query43	503	473	464	464
query44	1254	745	757	745
query45	211	169	166	166
query46	1109	734	728	728
query47	1874	1749	1800	1749
query48	383	290	294	290
query49	1095	428	425	425
query50	817	422	414	414
query51	7098	7076	7055	7055
query52	100	91	90	90
query53	255	181	177	177
query54	923	444	446	444
query55	80	76	84	76
query56	278	260	264	260
query57	1169	1046	1084	1046
query58	234	220	253	220
query59	3090	2859	2665	2665
query60	298	272	263	263
query61	101	100	101	100
query62	828	665	656	656
query63	223	185	181	181
query64	5819	2383	1739	1739
query65	3253	3172	3110	3110
query66	1282	339	345	339
query67	15556	15158	15209	15158
query68	4095	545	564	545
query69	411	275	285	275
query70	1101	1030	1145	1030
query71	336	275	274	274
query72	6316	2299	2051	2051
query73	756	322	323	322
query74	9059	8845	8882	8845
query75	3419	2705	2759	2705
query76	2488	982	1033	982
query77	464	333	341	333
query78	10643	9148	9388	9148
query79	1044	546	536	536
query80	697	505	491	491
query81	448	235	226	226
query82	229	138	141	138
query83	175	159	155	155
query84	226	82	80	80
query85	681	275	280	275
query86	317	310	300	300
query87	4314	4419	4295	4295
query88	2924	2320	2322	2320
query89	376	292	296	292
query90	1870	200	201	200
query91	196	98	100	98
query92	62	50	51	50
query93	1049	548	546	546
query94	758	301	311	301
query95	370	267	271	267
query96	594	272	277	272
query97	3245	3099	3036	3036
query98	216	219	202	202
query99	1447	1261	1291	1261
Total cold run time: 289557 ms
Total hot run time: 186180 ms

doris-robot avatar Aug 27 '24 05:08 doris-robot

ClickBench: Total hot run time: 30.8 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bcd32caca49e571e8d02567dd11536b4459cba10, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.67	0.09	0.09
query5	0.51	0.49	0.51
query6	1.13	0.71	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.56	0.49	0.49
query10	0.54	0.52	0.54
query11	0.16	0.12	0.12
query12	0.16	0.13	0.12
query13	0.61	0.58	0.58
query14	0.77	0.78	0.78
query15	0.91	0.81	0.81
query16	0.36	0.37	0.41
query17	1.05	1.05	1.04
query18	0.21	0.20	0.20
query19	1.88	1.75	1.88
query20	0.02	0.01	0.01
query21	15.40	0.66	0.66
query22	4.19	7.56	1.72
query23	18.27	1.36	1.34
query24	2.22	0.22	0.21
query25	0.15	0.08	0.08
query26	0.28	0.17	0.17
query27	0.07	0.08	0.08
query28	13.19	1.03	1.00
query29	12.59	3.40	3.35
query30	0.26	0.06	0.05
query31	2.86	0.40	0.40
query32	3.24	0.48	0.47
query33	2.98	3.00	3.05
query34	16.95	4.43	4.40
query35	4.51	4.53	4.51
query36	0.66	0.49	0.52
query37	0.18	0.16	0.16
query38	0.16	0.16	0.16
query39	0.05	0.04	0.04
query40	0.17	0.13	0.14
query41	0.09	0.04	0.05
query42	0.06	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.54 s
Total hot run time: 30.8 s

doris-robot avatar Aug 27 '24 05:08 doris-robot

run buildall

924060929 avatar Aug 29 '24 02:08 924060929

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 29 '24 02:08 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 29 '24 02:08 github-actions[bot]

TPC-H: Total hot run time: 38327 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4760f3940ae846dd3685d1d0e884182b53257c90, data reload: false

------ Round 1 ----------------------------------
q1	18124	4522	4340	4340
q2	2016	204	176	176
q3	11517	960	1076	960
q4	10166	817	699	699
q5	7762	2903	2854	2854
q6	234	140	144	140
q7	955	623	612	612
q8	9335	2073	2124	2073
q9	7224	6549	6573	6549
q10	6979	2282	2192	2192
q11	462	250	240	240
q12	408	219	228	219
q13	18849	3060	3080	3060
q14	310	237	247	237
q15	536	503	484	484
q16	629	507	502	502
q17	1008	707	696	696
q18	7603	6955	6973	6955
q19	1382	1109	1063	1063
q20	677	352	338	338
q21	4245	3175	2915	2915
q22	1105	1039	1023	1023
Total cold run time: 111526 ms
Total hot run time: 38327 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4342	4327	4245	4245
q2	389	287	289	287
q3	2886	2651	2663	2651
q4	1970	1640	1666	1640
q5	5728	5677	5763	5677
q6	246	142	137	137
q7	2243	1881	1856	1856
q8	3332	3422	3541	3422
q9	8856	8862	8853	8853
q10	3563	3372	3361	3361
q11	622	516	508	508
q12	880	667	684	667
q13	15181	3183	3284	3183
q14	326	308	276	276
q15	541	489	491	489
q16	622	589	589	589
q17	1835	1591	1558	1558
q18	8206	7832	7941	7832
q19	1768	1658	1511	1511
q20	2165	1910	1956	1910
q21	5857	5375	5428	5375
q22	1114	1051	1037	1037
Total cold run time: 72672 ms
Total hot run time: 57064 ms

doris-robot avatar Aug 29 '24 04:08 doris-robot

TPC-DS: Total hot run time: 193679 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4760f3940ae846dd3685d1d0e884182b53257c90, data reload: false

query1	1262	891	862	862
query2	6357	1983	1943	1943
query3	10631	3962	3999	3962
query4	59964	27180	23247	23247
query5	5597	505	498	498
query6	427	162	171	162
query7	5823	300	291	291
query8	291	208	210	208
query9	8935	2505	2503	2503
query10	505	268	255	255
query11	17614	15175	15574	15175
query12	165	106	102	102
query13	1556	414	397	397
query14	11401	7471	7477	7471
query15	233	182	177	177
query16	7708	506	478	478
query17	1170	564	555	555
query18	2038	303	319	303
query19	281	154	145	145
query20	115	108	107	107
query21	209	103	110	103
query22	4642	4348	4508	4348
query23	34431	33654	33412	33412
query24	5915	2910	2882	2882
query25	553	403	403	403
query26	686	163	163	163
query27	1768	293	285	285
query28	3819	2148	2135	2135
query29	745	431	426	426
query30	242	163	160	160
query31	953	765	789	765
query32	90	59	62	59
query33	462	299	301	299
query34	872	483	488	483
query35	807	735	719	719
query36	1060	915	921	915
query37	146	96	93	93
query38	4021	3958	3821	3821
query39	1454	1397	1411	1397
query40	202	120	123	120
query41	49	48	49	48
query42	116	97	97	97
query43	506	483	478	478
query44	1101	758	752	752
query45	205	166	169	166
query46	1108	756	789	756
query47	1915	1792	1787	1787
query48	387	307	301	301
query49	782	444	444	444
query50	818	433	429	429
query51	7171	7073	7181	7073
query52	104	92	89	89
query53	258	186	182	182
query54	582	470	464	464
query55	79	78	80	78
query56	292	268	266	266
query57	1185	1047	1164	1047
query58	231	236	258	236
query59	3080	2758	2719	2719
query60	296	269	268	268
query61	112	102	101	101
query62	758	649	666	649
query63	218	183	191	183
query64	2888	692	681	681
query65	3267	3166	3156	3156
query66	689	335	330	330
query67	15416	15219	15095	15095
query68	3292	587	590	587
query69	403	297	290	290
query70	1173	1148	1078	1078
query71	364	275	271	271
query72	6353	3958	3984	3958
query73	760	340	339	339
query74	9186	8829	8816	8816
query75	3373	2692	2691	2691
query76	1538	1044	983	983
query77	523	310	334	310
query78	10795	9272	9268	9268
query79	1099	532	532	532
query80	763	504	509	504
query81	533	232	235	232
query82	248	155	152	152
query83	172	146	152	146
query84	258	80	77	77
query85	724	300	290	290
query86	391	296	302	296
query87	4364	4260	4249	4249
query88	3013	2465	2371	2371
query89	388	298	288	288
query90	1868	196	193	193
query91	125	99	103	99
query92	66	55	61	55
query93	1080	547	546	546
query94	756	318	311	311
query95	358	271	274	271
query96	588	281	270	270
query97	3220	3078	3049	3049
query98	217	209	193	193
query99	1535	1269	1260	1260
Total cold run time: 308289 ms
Total hot run time: 193679 ms

doris-robot avatar Aug 29 '24 04:08 doris-robot

ClickBench: Total hot run time: 32 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4760f3940ae846dd3685d1d0e884182b53257c90, data reload: false

query1	0.05	0.04	0.04
query2	0.08	0.05	0.04
query3	0.23	0.05	0.06
query4	1.65	0.08	0.08
query5	0.51	0.48	0.49
query6	1.13	0.74	0.74
query7	0.02	0.01	0.02
query8	0.06	0.04	0.04
query9	0.54	0.49	0.48
query10	0.55	0.54	0.54
query11	0.15	0.12	0.12
query12	0.15	0.12	0.13
query13	0.61	0.60	0.58
query14	2.04	2.05	2.09
query15	0.84	0.83	0.81
query16	0.37	0.37	0.39
query17	1.06	0.98	0.99
query18	0.20	0.20	0.20
query19	1.85	1.71	1.78
query20	0.01	0.01	0.01
query21	15.40	0.69	0.68
query22	4.41	6.00	1.82
query23	18.30	1.45	1.34
query24	2.12	0.24	0.22
query25	0.15	0.08	0.08
query26	0.27	0.18	0.17
query27	0.08	0.07	0.08
query28	13.30	1.03	1.00
query29	12.60	3.38	3.39
query30	0.24	0.06	0.05
query31	2.86	0.39	0.40
query32	3.25	0.46	0.49
query33	2.98	3.12	3.03
query34	17.14	4.43	4.37
query35	4.47	4.41	4.45
query36	0.64	0.48	0.49
query37	0.19	0.15	0.16
query38	0.16	0.15	0.16
query39	0.05	0.04	0.04
query40	0.16	0.13	0.12
query41	0.09	0.05	0.06
query42	0.05	0.05	0.05
query43	0.05	0.05	0.04
Total cold run time: 111.06 s
Total hot run time: 32 s

doris-robot avatar Aug 29 '24 04:08 doris-robot

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Aug 29 '24 06:08 github-actions[bot]