doris icon indicating copy to clipboard operation
doris copied to clipboard

[fix](hudi) revert hbase version to 2.4.9

Open AshinGau opened this issue 1 year ago • 3 comments

Introduced from #33360 Missing hase-unsafe dependency

AshinGau avatar May 31 '24 07:05 AshinGau

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 31 '24 07:05 doris-robot

run buildall

morningman avatar May 31 '24 07:05 morningman

TPC-H: Total hot run time: 49588 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 98b31cdc288d2adf0e497bc4b27b954abde14408, data reload: false

------ Round 1 ----------------------------------
q1	17921	4427	4312	4312
q2	2077	152	146	146
q3	10346	1931	1945	1931
q4	10337	1234	1331	1234
q5	8331	3898	3943	3898
q6	234	125	146	125
q7	2057	1603	1631	1603
q8	9534	2752	2735	2735
q9	14110	10470	10191	10191
q10	8680	3559	3541	3541
q11	415	250	253	250
q12	473	299	304	299
q13	18350	3953	3977	3953
q14	356	332	333	332
q15	504	471	457	457
q16	667	567	573	567
q17	1145	954	926	926
q18	7305	6841	6880	6841
q19	1720	1584	1550	1550
q20	551	297	307	297
q21	4404	4221	4026	4026
q22	498	374	405	374
Total cold run time: 120015 ms
Total hot run time: 49588 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4346	4308	4263	4263
q2	323	229	225	225
q3	4189	4104	4137	4104
q4	2754	2744	2737	2737
q5	7192	7071	7129	7071
q6	241	119	120	119
q7	3215	2823	2820	2820
q8	4370	4455	4493	4455
q9	16902	16765	16767	16765
q10	4269	4297	4238	4238
q11	774	676	686	676
q12	1037	856	843	843
q13	7052	3764	3726	3726
q14	457	420	437	420
q15	502	453	452	452
q16	729	672	677	672
q17	3786	3792	3759	3759
q18	8735	8838	8828	8828
q19	1738	1685	1684	1684
q20	2388	2102	2111	2102
q21	8414	8379	8505	8379
q22	1008	907	948	907
Total cold run time: 84421 ms
Total hot run time: 79245 ms

doris-robot avatar May 31 '24 08:05 doris-robot

TPC-DS: Total hot run time: 203362 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 98b31cdc288d2adf0e497bc4b27b954abde14408, data reload: false

query1	920	388	432	388
query2	6558	2826	2770	2770
query3	6916	213	210	210
query4	21232	17964	17973	17964
query5	19739	6553	6467	6467
query6	294	216	225	216
query7	4160	300	305	300
query8	252	232	264	232
query9	3144	2674	2637	2637
query10	418	292	285	285
query11	11333	10628	10706	10628
query12	126	80	76	76
query13	5595	680	677	677
query14	18087	13042	14121	13042
query15	367	224	231	224
query16	6498	301	274	274
query17	1664	1456	877	877
query18	2315	414	405	405
query19	216	152	164	152
query20	79	81	78	78
query21	191	99	89	89
query22	5149	5136	5106	5106
query23	32586	32072	31981	31981
query24	6972	6504	6511	6504
query25	530	420	422	420
query26	613	161	155	155
query27	2002	293	289	289
query28	6101	2339	2300	2300
query29	2825	2761	2569	2569
query30	242	164	170	164
query31	910	736	734	734
query32	73	63	61	61
query33	406	271	250	250
query34	857	484	470	470
query35	1124	882	937	882
query36	1285	1260	1307	1260
query37	90	69	60	60
query38	3088	2947	2884	2884
query39	1384	1329	1300	1300
query40	203	95	91	91
query41	40	39	36	36
query42	88	83	89	83
query43	808	879	671	671
query44	1116	722	728	722
query45	238	229	227	227
query46	1235	973	979	973
query47	1911	1641	1860	1641
query48	1004	708	700	700
query49	627	373	373	373
query50	887	613	608	608
query51	4796	4659	4623	4623
query52	95	84	77	77
query53	445	307	310	307
query54	2650	2450	2464	2450
query55	92	77	81	77
query56	238	225	215	215
query57	1297	1157	1102	1102
query58	229	203	212	203
query59	4048	4093	3607	3607
query60	217	210	220	210
query61	102	94	96	94
query62	807	435	458	435
query63	488	334	331	331
query64	2647	1544	1533	1533
query65	3645	3556	3574	3556
query66	819	380	382	380
query67	15767	16017	15519	15519
query68	10194	660	648	648
query69	579	344	359	344
query70	2023	1318	1619	1318
query71	421	313	321	313
query72	6613	3457	3512	3457
query73	742	327	326	326
query74	6245	5850	5801	5801
query75	5419	3694	3732	3694
query76	6616	1141	1204	1141
query77	1129	249	267	249
query78	12618	13149	12012	12012
query79	9004	658	656	656
query80	681	401	402	401
query81	488	238	231	231
query82	347	103	103	103
query83	163	136	134	134
query84	256	72	69	69
query85	720	322	320	320
query86	322	304	298	298
query87	3237	3068	3044	3044
query88	3951	2345	2335	2335
query89	364	303	285	285
query90	1912	200	211	200
query91	173	137	139	137
query92	58	53	55	53
query93	3050	604	565	565
query94	651	212	212	212
query95	1103	1069	1054	1054
query96	643	329	332	329
query97	6487	6510	6355	6355
query98	179	196	166	166
query99	2866	888	918	888
Total cold run time: 312134 ms
Total hot run time: 203362 ms

doris-robot avatar May 31 '24 08:05 doris-robot

ClickBench: Total hot run time: 30.88 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 98b31cdc288d2adf0e497bc4b27b954abde14408, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.02	0.02
query3	0.24	0.04	0.04
query4	1.78	0.05	0.06
query5	0.53	0.53	0.52
query6	1.23	0.62	0.61
query7	0.01	0.01	0.01
query8	0.03	0.03	0.02
query9	0.55	0.49	0.48
query10	0.55	0.52	0.53
query11	0.12	0.09	0.08
query12	0.12	0.09	0.09
query13	0.62	0.62	0.61
query14	0.79	0.80	0.77
query15	0.77	0.77	0.77
query16	0.36	0.36	0.37
query17	1.03	1.01	1.02
query18	0.24	0.25	0.26
query19	1.93	1.89	1.88
query20	0.02	0.01	0.01
query21	15.48	0.57	0.58
query22	1.97	2.36	1.73
query23	16.76	1.11	1.08
query24	5.84	1.02	0.94
query25	0.35	0.10	0.05
query26	0.64	0.15	0.16
query27	0.05	0.04	0.04
query28	7.39	0.75	0.76
query29	12.66	2.29	2.16
query30	0.56	0.49	0.54
query31	2.80	0.38	0.37
query32	3.38	0.50	0.49
query33	3.05	3.05	3.05
query34	15.25	4.82	4.80
query35	4.86	4.83	4.84
query36	1.08	1.02	1.02
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.17	0.13	0.14
query41	0.06	0.01	0.01
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.51 s
Total hot run time: 30.88 s

doris-robot avatar May 31 '24 08:05 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 98b31cdc288d2adf0e497bc4b27b954abde14408 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

doris-robot avatar May 31 '24 08:05 doris-robot

run buildall

morningman avatar May 31 '24 14:05 morningman

TPC-H: Total hot run time: 50264 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ac9d46a7c1dc2f69ce2d6c7e5a4f9c2b105520bd, data reload: false

------ Round 1 ----------------------------------
q1	17535	4385	4339	4339
q2	2064	157	150	150
q3	10256	1970	1966	1966
q4	10106	1294	1328	1294
q5	8459	3971	3895	3895
q6	239	128	124	124
q7	2035	1579	1627	1579
q8	9336	2752	2718	2718
q9	10760	10909	10741	10741
q10	8671	3513	3494	3494
q11	434	251	246	246
q12	466	296	307	296
q13	18380	3969	4027	3969
q14	354	331	325	325
q15	504	454	461	454
q16	691	574	570	570
q17	1143	952	971	952
q18	7307	6923	6952	6923
q19	1730	1547	1469	1469
q20	569	299	306	299
q21	4405	4119	4068	4068
q22	496	393	405	393
Total cold run time: 115940 ms
Total hot run time: 50264 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4355	4316	4306	4306
q2	324	234	225	225
q3	4214	4160	4136	4136
q4	2751	2755	2767	2755
q5	7191	7137	7174	7137
q6	241	117	119	117
q7	3215	2880	2837	2837
q8	4337	4500	4537	4500
q9	16910	16706	17019	16706
q10	4255	4268	4325	4268
q11	770	719	654	654
q12	1033	874	858	858
q13	7102	3760	3733	3733
q14	456	436	447	436
q15	505	452	445	445
q16	753	684	676	676
q17	3905	3857	3836	3836
q18	8889	8774	8849	8774
q19	1730	1730	1693	1693
q20	2371	2130	2127	2127
q21	8463	8482	8554	8482
q22	1007	934	921	921
Total cold run time: 84777 ms
Total hot run time: 79622 ms

doris-robot avatar May 31 '24 15:05 doris-robot

TPC-DS: Total hot run time: 203248 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ac9d46a7c1dc2f69ce2d6c7e5a4f9c2b105520bd, data reload: false

query1	962	400	383	383
query2	6525	2695	2666	2666
query3	6920	211	204	204
query4	20741	18038	18055	18038
query5	19747	6528	6505	6505
query6	299	219	232	219
query7	4157	296	305	296
query8	265	238	237	237
query9	3142	2728	2657	2657
query10	417	318	301	301
query11	11452	10647	10746	10647
query12	133	75	75	75
query13	5594	698	690	690
query14	17296	13115	13310	13115
query15	366	233	237	233
query16	6476	287	267	267
query17	1711	1449	890	890
query18	2313	428	408	408
query19	210	151	147	147
query20	85	77	79	77
query21	186	94	95	94
query22	5189	5070	5003	5003
query23	32511	31894	31946	31894
query24	7133	6485	6490	6485
query25	539	440	429	429
query26	528	169	163	163
query27	1861	298	300	298
query28	6229	2333	2306	2306
query29	2964	2735	2785	2735
query30	242	165	170	165
query31	910	743	757	743
query32	72	65	61	61
query33	411	265	254	254
query34	852	485	489	485
query35	1116	913	930	913
query36	1465	1330	1195	1195
query37	92	64	65	64
query38	3079	2939	2950	2939
query39	1397	1352	1313	1313
query40	209	96	99	96
query41	40	37	38	37
query42	89	91	79	79
query43	816	886	720	720
query44	1125	727	724	724
query45	246	228	233	228
query46	1234	954	970	954
query47	1913	1675	1847	1675
query48	1024	732	700	700
query49	619	371	383	371
query50	865	625	613	613
query51	4727	4767	4668	4668
query52	91	78	87	78
query53	450	327	319	319
query54	2662	2506	2490	2490
query55	94	82	91	82
query56	231	229	197	197
query57	1232	1130	1039	1039
query58	219	204	213	204
query59	4137	3822	3777	3777
query60	213	235	209	209
query61	96	93	92	92
query62	872	577	476	476
query63	485	345	344	344
query64	2581	1562	1516	1516
query65	3636	3540	3565	3540
query66	808	376	383	376
query67	16129	15349	15606	15349
query68	9428	634	684	634
query69	583	365	357	357
query70	1761	1461	1347	1347
query71	418	313	325	313
query72	6494	3485	3512	3485
query73	741	331	322	322
query74	6294	5903	5864	5864
query75	5387	3798	3644	3644
query76	5833	1133	1188	1133
query77	982	259	266	259
query78	12665	11509	11569	11509
query79	7892	633	673	633
query80	1367	414	406	406
query81	498	239	240	239
query82	1625	95	100	95
query83	171	135	134	134
query84	265	71	74	71
query85	870	316	318	316
query86	336	292	304	292
query87	3240	3034	3034	3034
query88	4992	2353	2353	2353
query89	394	302	307	302
query90	1955	198	218	198
query91	171	137	141	137
query92	61	51	54	51
query93	5901	555	602	555
query94	719	214	217	214
query95	1133	1078	1072	1072
query96	645	338	331	331
query97	6544	6333	6475	6333
query98	190	180	178	178
query99	2944	890	983	890
Total cold run time: 314929 ms
Total hot run time: 203248 ms

doris-robot avatar May 31 '24 15:05 doris-robot

ClickBench: Total hot run time: 30.02 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ac9d46a7c1dc2f69ce2d6c7e5a4f9c2b105520bd, data reload: false

query1	0.02	0.02	0.02
query2	0.06	0.03	0.02
query3	0.25	0.05	0.05
query4	1.78	0.06	0.06
query5	0.55	0.53	0.53
query6	1.26	0.62	0.61
query7	0.01	0.01	0.02
query8	0.03	0.02	0.02
query9	0.53	0.50	0.49
query10	0.54	0.54	0.54
query11	0.12	0.08	0.08
query12	0.11	0.09	0.09
query13	0.63	0.62	0.60
query14	0.80	0.80	0.78
query15	0.79	0.76	0.76
query16	0.38	0.35	0.36
query17	0.98	1.01	0.95
query18	0.24	0.26	0.23
query19	1.90	1.86	1.79
query20	0.01	0.01	0.01
query21	15.48	0.55	0.54
query22	2.09	2.70	0.91
query23	16.79	1.00	0.97
query24	5.88	0.96	1.63
query25	0.37	0.10	0.04
query26	0.75	0.15	0.17
query27	0.04	0.03	0.05
query28	6.69	0.80	0.77
query29	12.68	2.35	2.38
query30	0.59	0.53	0.53
query31	2.81	0.39	0.37
query32	3.38	0.49	0.49
query33	3.08	3.07	3.05
query34	15.26	4.79	4.78
query35	4.84	4.86	4.84
query36	1.07	1.01	1.01
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.01
Total cold run time: 103.16 s
Total hot run time: 30.02 s

doris-robot avatar May 31 '24 15:05 doris-robot

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit ac9d46a7c1dc2f69ce2d6c7e5a4f9c2b105520bd with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.7 seconds inserted 10000000 Rows, about 460K ops/s

doris-robot avatar May 31 '24 15:05 doris-robot