doris icon indicating copy to clipboard operation
doris copied to clipboard

[fix](metrics) Fix doris compaction deltas total

Open w41ter opened this issue 1 year ago • 8 comments

w41ter avatar Oct 18 '24 04:10 w41ter

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar Oct 18 '24 04:10 doris-robot

run buildall

w41ter avatar Oct 18 '24 04:10 w41ter

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar Oct 18 '24 04:10 github-actions[bot]

TPC-H: Total hot run time: 41387 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 56b200d377a5922752584c9c345b7de7970a7222, data reload: false

------ Round 1 ----------------------------------
q1	17577	8243	7287	7287
q2	2047	281	273	273
q3	12000	1069	1163	1069
q4	10589	856	846	846
q5	7737	3119	3074	3074
q6	238	154	149	149
q7	1015	614	603	603
q8	9368	1979	1945	1945
q9	6662	6519	6479	6479
q10	7096	2430	2452	2430
q11	458	253	249	249
q12	423	222	214	214
q13	17854	3046	3013	3013
q14	244	215	220	215
q15	581	518	514	514
q16	653	591	591	591
q17	987	500	518	500
q18	7466	6738	6660	6660
q19	1355	917	972	917
q20	502	185	183	183
q21	4032	3194	3185	3185
q22	1121	991	1002	991
Total cold run time: 110005 ms
Total hot run time: 41387 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7276	7259	7262	7259
q2	334	239	237	237
q3	3080	2940	3059	2940
q4	2099	1864	1835	1835
q5	5766	5823	5834	5823
q6	238	146	150	146
q7	2265	1867	1879	1867
q8	3359	3495	3512	3495
q9	8971	8996	9036	8996
q10	3568	3631	3569	3569
q11	610	494	491	491
q12	840	606	625	606
q13	9673	3178	3187	3178
q14	307	277	279	277
q15	574	536	525	525
q16	711	635	646	635
q17	1849	1638	1639	1638
q18	8304	7930	7790	7790
q19	1747	1472	1311	1311
q20	2155	1865	1905	1865
q21	5634	5545	5412	5412
q22	1175	1048	1041	1041
Total cold run time: 70535 ms
Total hot run time: 60936 ms

doris-robot avatar Oct 18 '24 05:10 doris-robot

TPC-DS: Total hot run time: 192638 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 56b200d377a5922752584c9c345b7de7970a7222, data reload: false

query1	862	385	398	385
query2	6242	2178	2100	2100
query3	8681	191	207	191
query4	34160	23643	23664	23643
query5	3331	473	466	466
query6	260	172	166	166
query7	4193	296	291	291
query8	288	236	235	235
query9	9452	2722	2715	2715
query10	466	278	275	275
query11	18033	15232	15234	15232
query12	145	106	106	106
query13	1572	434	418	418
query14	9690	7266	7591	7266
query15	253	168	181	168
query16	7760	460	468	460
query17	1605	622	594	594
query18	2115	313	316	313
query19	350	158	160	158
query20	124	111	114	111
query21	217	109	107	107
query22	4721	4470	4499	4470
query23	35210	34557	34435	34435
query24	10858	2806	2758	2758
query25	626	418	390	390
query26	1116	158	162	158
query27	2281	287	291	287
query28	7545	2456	2423	2423
query29	824	436	418	418
query30	262	148	161	148
query31	1053	799	799	799
query32	98	55	61	55
query33	766	298	294	294
query34	918	516	506	506
query35	929	782	757	757
query36	1103	941	950	941
query37	164	86	86	86
query38	4031	3921	3936	3921
query39	1583	1406	1437	1406
query40	207	99	99	99
query41	49	46	48	46
query42	128	102	101	101
query43	553	493	493	493
query44	1310	814	798	798
query45	195	169	175	169
query46	1166	690	710	690
query47	1947	1832	1834	1832
query48	437	327	333	327
query49	965	442	431	431
query50	826	388	390	388
query51	7088	6973	6983	6973
query52	103	87	88	87
query53	257	185	179	179
query54	1197	431	434	431
query55	83	77	79	77
query56	289	291	265	265
query57	1321	1166	1184	1166
query58	235	245	234	234
query59	3254	3184	3078	3078
query60	288	263	278	263
query61	102	99	99	99
query62	875	659	661	659
query63	231	181	181	181
query64	3952	653	606	606
query65	3307	3193	3208	3193
query66	829	338	309	309
query67	15878	15683	15752	15683
query68	4598	568	557	557
query69	460	293	294	293
query70	1150	1126	1072	1072
query71	339	274	271	271
query72	7087	3947	3952	3947
query73	775	371	360	360
query74	9597	8996	9021	8996
query75	3425	2669	2716	2669
query76	2777	860	940	860
query77	557	301	306	301
query78	10602	9605	9582	9582
query79	3690	608	599	599
query80	874	443	445	443
query81	583	242	242	242
query82	716	140	133	133
query83	290	135	136	135
query84	272	73	69	69
query85	1164	298	275	275
query86	309	292	284	284
query87	4441	4306	4302	4302
query88	3851	2195	2193	2193
query89	415	291	288	288
query90	2055	184	186	184
query91	151	98	104	98
query92	65	48	48	48
query93	2071	538	531	531
query94	866	294	283	283
query95	340	247	243	243
query96	620	275	279	275
query97	3271	3126	3115	3115
query98	216	214	191	191
query99	1575	1330	1290	1290
Total cold run time: 300161 ms
Total hot run time: 192638 ms

doris-robot avatar Oct 18 '24 05:10 doris-robot

ClickBench: Total hot run time: 33.12 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 56b200d377a5922752584c9c345b7de7970a7222, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.63	0.10	0.10
query5	0.51	0.51	0.52
query6	1.14	0.73	0.73
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.51	0.51
query10	0.55	0.55	0.56
query11	0.14	0.10	0.11
query12	0.13	0.11	0.11
query13	0.60	0.60	0.63
query14	2.70	2.74	2.81
query15	0.90	0.82	0.82
query16	0.37	0.38	0.37
query17	1.06	1.03	1.03
query18	0.20	0.20	0.21
query19	1.87	1.92	2.06
query20	0.01	0.01	0.01
query21	15.38	0.59	0.56
query22	2.41	2.74	1.87
query23	16.84	1.33	0.88
query24	2.95	1.23	2.01
query25	0.27	0.14	0.06
query26	0.64	0.13	0.13
query27	0.05	0.05	0.03
query28	9.98	1.09	1.08
query29	12.58	3.22	3.20
query30	0.25	0.06	0.07
query31	2.86	0.38	0.38
query32	3.28	0.47	0.46
query33	3.02	3.00	3.03
query34	16.85	4.48	4.49
query35	4.52	4.45	4.46
query36	0.67	0.49	0.49
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.15	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 105.75 s
Total hot run time: 33.12 s

doris-robot avatar Oct 18 '24 05:10 doris-robot

TeamCity be ut coverage result: Function Coverage: 37.47% (9711/25916) Line Coverage: 28.74% (80643/280575) Region Coverage: 28.17% (41714/148075) Branch Coverage: 24.75% (21207/85688) Coverage Report: http://coverage.selectdb-in.cc/coverage/56b200d377a5922752584c9c345b7de7970a7222_56b200d377a5922752584c9c345b7de7970a7222/report/index.html

doris-robot avatar Oct 18 '24 05:10 doris-robot

PR approved by anyone and no changes requested.

github-actions[bot] avatar Oct 18 '24 08:10 github-actions[bot]

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar Oct 21 '24 12:10 github-actions[bot]