doris icon indicating copy to clipboard operation
doris copied to clipboard

[cases](array_contains)add cases for array_contains supporting inverted index and fix stopwords as query string

Open amorynan opened this issue 1 year ago • 15 comments

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

amorynan avatar May 23 '24 10:05 amorynan

Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.

doris-robot avatar May 23 '24 10:05 doris-robot

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 10:05 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 10:05 github-actions[bot]

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 23 '24 11:05 github-actions[bot]

run buildall

amorynan avatar May 24 '24 01:05 amorynan

TPC-H: Total hot run time: 40186 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 893eb1d9ecd3bd22802cffd228a15075ca1d5d7e, data reload: false

------ Round 1 ----------------------------------
q1	17655	4372	4222	4222
q2	2023	187	183	183
q3	10531	1241	1288	1241
q4	10502	760	820	760
q5	7863	2658	2686	2658
q6	225	132	134	132
q7	954	620	604	604
q8	9589	2102	2109	2102
q9	9135	6629	6655	6629
q10	9015	3704	3698	3698
q11	451	245	231	231
q12	452	216	217	216
q13	17752	2993	2991	2991
q14	250	224	217	217
q15	512	471	472	471
q16	493	388	388	388
q17	973	652	628	628
q18	8069	7475	7477	7475
q19	4116	1565	1527	1527
q20	698	308	299	299
q21	4922	3239	3915	3239
q22	349	294	275	275
Total cold run time: 116529 ms
Total hot run time: 40186 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4321	4185	4226	4185
q2	369	271	277	271
q3	3002	2724	2752	2724
q4	1856	1573	1563	1563
q5	5231	5254	5277	5254
q6	213	124	126	124
q7	2118	1700	1721	1700
q8	3187	3341	3339	3339
q9	8319	8318	8287	8287
q10	3871	3688	3713	3688
q11	584	489	478	478
q12	773	586	630	586
q13	16210	2982	3003	2982
q14	293	258	244	244
q15	527	471	470	470
q16	463	416	429	416
q17	1750	1490	1475	1475
q18	7578	7825	7517	7517
q19	1668	1545	1498	1498
q20	1993	1800	1787	1787
q21	4943	4771	4777	4771
q22	593	510	489	489
Total cold run time: 69862 ms
Total hot run time: 53848 ms

doris-robot avatar May 24 '24 01:05 doris-robot

TeamCity be ut coverage result: Function Coverage: 35.65% (9017/25294) Line Coverage: 27.31% (74560/273052) Region Coverage: 26.53% (38586/145428) Branch Coverage: 23.40% (19688/84134) Coverage Report: http://coverage.selectdb-in.cc/coverage/893eb1d9ecd3bd22802cffd228a15075ca1d5d7e_893eb1d9ecd3bd22802cffd228a15075ca1d5d7e/report/index.html

doris-robot avatar May 24 '24 01:05 doris-robot

TPC-DS: Total hot run time: 172243 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 893eb1d9ecd3bd22802cffd228a15075ca1d5d7e, data reload: false

query1	915	397	363	363
query2	6452	2338	2320	2320
query3	6656	212	208	208
query4	19001	17373	17311	17311
query5	4149	446	411	411
query6	245	152	170	152
query7	4598	300	291	291
query8	250	195	185	185
query9	8621	2365	2354	2354
query10	460	280	265	265
query11	10463	10079	10204	10079
query12	133	94	92	92
query13	1651	367	366	366
query14	8741	6927	6851	6851
query15	230	167	172	167
query16	7927	278	270	270
query17	1842	536	567	536
query18	1863	265	265	265
query19	196	152	152	152
query20	97	87	87	87
query21	196	127	126	126
query22	4213	4059	3924	3924
query23	33881	33068	33227	33068
query24	12129	2870	2848	2848
query25	672	356	363	356
query26	1813	156	154	154
query27	3000	314	319	314
query28	7719	2016	2020	2016
query29	1078	624	590	590
query30	309	170	171	170
query31	994	772	764	764
query32	93	53	57	53
query33	785	279	263	263
query34	1039	473	475	473
query35	747	608	606	606
query36	1078	949	907	907
query37	276	69	71	69
query38	2892	2786	2763	2763
query39	862	809	828	809
query40	273	123	124	123
query41	46	45	44	44
query42	104	96	99	96
query43	625	579	566	566
query44	1240	719	736	719
query45	186	169	165	165
query46	1065	738	736	736
query47	1865	1767	1774	1767
query48	390	304	292	292
query49	1179	381	392	381
query50	763	379	381	379
query51	6915	6858	6850	6850
query52	100	91	91	91
query53	347	280	279	279
query54	1036	441	425	425
query55	73	73	73	73
query56	259	233	252	233
query57	1140	1029	1028	1028
query58	246	240	223	223
query59	3353	3066	3210	3066
query60	279	280	251	251
query61	91	89	95	89
query62	656	459	469	459
query63	315	280	284	280
query64	9755	2224	1733	1733
query65	3161	3096	3108	3096
query66	1392	328	326	326
query67	15479	14650	14835	14650
query68	4535	536	529	529
query69	449	273	265	265
query70	1168	1148	1143	1143
query71	430	268	267	267
query72	7663	5445	5391	5391
query73	721	319	318	318
query74	6118	5748	5579	5579
query75	3458	2621	2590	2590
query76	2981	980	975	975
query77	556	271	262	262
query78	10324	9907	9885	9885
query79	2482	524	508	508
query80	1087	451	456	451
query81	531	245	248	245
query82	748	99	94	94
query83	259	171	173	171
query84	238	86	81	81
query85	1606	279	261	261
query86	555	318	322	318
query87	3264	3080	3116	3080
query88	4261	2344	2341	2341
query89	474	384	398	384
query90	1992	192	190	190
query91	127	98	97	97
query92	61	48	50	48
query93	1835	516	507	507
query94	1214	184	185	184
query95	392	309	311	309
query96	589	261	261	261
query97	3242	3110	3018	3018
query98	239	227	213	213
query99	1102	860	862	860
Total cold run time: 275300 ms
Total hot run time: 172243 ms

doris-robot avatar May 24 '24 01:05 doris-robot

ClickBench: Total hot run time: 30.43 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 893eb1d9ecd3bd22802cffd228a15075ca1d5d7e, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.24	0.05	0.05
query4	1.68	0.08	0.07
query5	0.49	0.49	0.50
query6	1.11	0.74	0.73
query7	0.01	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.47	0.49
query10	0.54	0.55	0.54
query11	0.16	0.12	0.11
query12	0.15	0.12	0.13
query13	0.60	0.59	0.61
query14	0.76	0.79	0.77
query15	0.84	0.80	0.80
query16	0.36	0.37	0.37
query17	1.03	0.96	1.03
query18	0.23	0.23	0.26
query19	1.85	1.69	1.76
query20	0.01	0.01	0.01
query21	15.74	0.64	0.64
query22	4.36	7.22	1.96
query23	18.29	1.30	1.33
query24	2.01	0.22	0.20
query25	0.14	0.08	0.08
query26	0.27	0.16	0.17
query27	0.09	0.09	0.09
query28	13.36	1.01	0.99
query29	13.16	3.27	3.28
query30	0.24	0.06	0.06
query31	2.86	0.39	0.39
query32	3.33	0.48	0.46
query33	2.85	2.92	2.83
query34	17.11	4.41	4.39
query35	4.51	4.48	4.47
query36	0.64	0.46	0.45
query37	0.18	0.16	0.15
query38	0.15	0.14	0.14
query39	0.05	0.03	0.04
query40	0.17	0.14	0.13
query41	0.08	0.04	0.05
query42	0.04	0.05	0.05
query43	0.04	0.04	0.03
Total cold run time: 110.45 s
Total hot run time: 30.43 s

doris-robot avatar May 24 '24 02:05 doris-robot

run buildall

amorynan avatar May 24 '24 11:05 amorynan

clang-tidy review says "All clean, LGTM! :+1:"

github-actions[bot] avatar May 24 '24 11:05 github-actions[bot]

TeamCity be ut coverage result: Function Coverage: 35.65% (9018/25297) Line Coverage: 27.31% (74582/273094) Region Coverage: 26.54% (38601/145458) Branch Coverage: 23.40% (19691/84154) Coverage Report: http://coverage.selectdb-in.cc/coverage/b776e3c1364525b57d6cf2c86c8596a8cbe9b6b3_b776e3c1364525b57d6cf2c86c8596a8cbe9b6b3/report/index.html

doris-robot avatar May 24 '24 11:05 doris-robot

TPC-H: Total hot run time: 41129 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b776e3c1364525b57d6cf2c86c8596a8cbe9b6b3, data reload: false

------ Round 1 ----------------------------------
q1	17602	4314	4203	4203
q2	2011	184	184	184
q3	10485	1165	1143	1143
q4	10201	804	811	804
q5	7457	2694	2683	2683
q6	223	134	130	130
q7	981	621	627	621
q8	9227	2131	2085	2085
q9	9498	6704	6734	6704
q10	9654	3897	3835	3835
q11	453	242	257	242
q12	485	223	241	223
q13	17453	3243	3201	3201
q14	258	218	220	218
q15	500	481	475	475
q16	483	393	384	384
q17	973	778	769	769
q18	8431	7807	7877	7807
q19	4368	1573	1582	1573
q20	646	324	318	318
q21	5192	3930	3246	3246
q22	360	281	285	281
Total cold run time: 116941 ms
Total hot run time: 41129 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4502	4404	4354	4354
q2	366	267	269	267
q3	3148	2915	2949	2915
q4	1867	1622	1606	1606
q5	5472	5485	5502	5485
q6	220	128	123	123
q7	2173	1847	1842	1842
q8	3309	3415	3373	3373
q9	8665	8694	8688	8688
q10	3983	3688	3812	3688
q11	606	494	503	494
q12	809	619	649	619
q13	16966	3188	3187	3187
q14	331	281	291	281
q15	526	489	475	475
q16	487	453	436	436
q17	1776	1465	1469	1465
q18	7695	7548	7416	7416
q19	1658	1577	1559	1559
q20	2070	1783	1819	1783
q21	13260	4720	4728	4720
q22	571	505	487	487
Total cold run time: 80460 ms
Total hot run time: 55263 ms

doris-robot avatar May 24 '24 12:05 doris-robot

TPC-DS: Total hot run time: 170993 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b776e3c1364525b57d6cf2c86c8596a8cbe9b6b3, data reload: false

query1	928	385	383	383
query2	6439	2447	2312	2312
query3	6657	203	211	203
query4	19088	17514	17328	17328
query5	4177	425	426	425
query6	248	162	158	158
query7	4586	295	287	287
query8	237	187	179	179
query9	8760	2437	2392	2392
query10	454	295	272	272
query11	10548	10136	10164	10136
query12	136	90	92	90
query13	1653	371	374	371
query14	9605	6462	6400	6400
query15	217	176	170	170
query16	7147	277	261	261
query17	1010	531	530	530
query18	1928	333	273	273
query19	196	154	161	154
query20	92	84	86	84
query21	196	133	128	128
query22	4366	4011	3836	3836
query23	33597	32924	33045	32924
query24	7109	2800	2844	2800
query25	578	353	369	353
query26	707	153	160	153
query27	2031	313	328	313
query28	3791	2067	2106	2067
query29	858	611	604	604
query30	236	173	170	170
query31	943	784	740	740
query32	93	51	50	50
query33	499	273	263	263
query34	889	466	473	466
query35	726	601	578	578
query36	1064	941	901	901
query37	106	70	72	70
query38	2906	2814	2769	2769
query39	820	786	790	786
query40	196	124	123	123
query41	46	41	44	41
query42	105	97	97	97
query43	564	558	540	540
query44	1090	740	757	740
query45	180	162	160	160
query46	1055	716	721	716
query47	1824	1761	1751	1751
query48	377	305	288	288
query49	817	376	387	376
query50	770	391	397	391
query51	6741	6719	6575	6575
query52	104	88	96	88
query53	351	289	287	287
query54	548	431	418	418
query55	76	71	72	71
query56	262	240	243	240
query57	1121	1049	1023	1023
query58	229	214	204	204
query59	3279	3283	3153	3153
query60	277	246	267	246
query61	94	90	87	87
query62	565	453	427	427
query63	312	284	279	279
query64	8463	2288	1730	1730
query65	3157	3068	3104	3068
query66	914	338	339	338
query67	15278	14924	14653	14653
query68	4573	542	542	542
query69	445	269	266	266
query70	1101	1129	1147	1129
query71	387	271	276	271
query72	7409	5448	5625	5448
query73	769	319	324	319
query74	6019	5705	5583	5583
query75	3334	2615	2612	2612
query76	2304	1004	936	936
query77	425	271	270	270
query78	10193	9959	9641	9641
query79	2386	507	523	507
query80	1018	431	421	421
query81	551	247	241	241
query82	960	103	92	92
query83	248	169	185	169
query84	266	84	84	84
query85	1047	281	265	265
query86	442	320	321	320
query87	3268	3143	3064	3064
query88	3582	2369	2324	2324
query89	480	383	367	367
query90	2063	188	182	182
query91	124	157	93	93
query92	62	48	48	48
query93	1718	513	497	497
query94	1188	182	183	182
query95	398	295	307	295
query96	586	259	267	259
query97	3177	3045	3009	3009
query98	244	212	213	212
query99	1163	856	863	856
Total cold run time: 256346 ms
Total hot run time: 170993 ms

doris-robot avatar May 24 '24 12:05 doris-robot

ClickBench: Total hot run time: 30.19 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b776e3c1364525b57d6cf2c86c8596a8cbe9b6b3, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.08	0.08
query5	0.50	0.53	0.51
query6	1.13	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.49	0.49
query10	0.55	0.54	0.55
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.59	0.59	0.58
query14	0.79	0.78	0.78
query15	0.83	0.82	0.81
query16	0.37	0.36	0.37
query17	1.01	1.00	1.03
query18	0.23	0.24	0.23
query19	1.88	1.77	1.78
query20	0.01	0.00	0.01
query21	15.42	0.70	0.69
query22	4.72	7.25	1.46
query23	18.25	1.26	1.25
query24	1.39	0.34	0.26
query25	0.13	0.09	0.08
query26	0.27	0.16	0.16
query27	0.08	0.07	0.08
query28	13.30	1.02	0.99
query29	13.19	3.29	3.25
query30	0.24	0.05	0.05
query31	2.86	0.38	0.39
query32	3.29	0.47	0.46
query33	2.89	2.86	2.90
query34	17.13	4.40	4.42
query35	4.52	4.49	4.54
query36	0.68	0.49	0.49
query37	0.17	0.16	0.15
query38	0.16	0.14	0.14
query39	0.04	0.03	0.04
query40	0.17	0.15	0.14
query41	0.09	0.05	0.04
query42	0.06	0.04	0.04
query43	0.03	0.04	0.04
Total cold run time: 109.91 s
Total hot run time: 30.19 s

doris-robot avatar May 24 '24 12:05 doris-robot

PR approved by at least one committer and no changes requested.

github-actions[bot] avatar May 26 '24 07:05 github-actions[bot]

PR approved by anyone and no changes requested.

github-actions[bot] avatar May 26 '24 07:05 github-actions[bot]