Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[debug](don't merge) test memtable on sink node dcheck #29120

Closed
wants to merge 6 commits into from

Conversation

kaijchen
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@kaijchen
Copy link
Contributor Author

run p0 10

@dataroaring
Copy link
Contributor

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit 40beffac6d71e9dc6fb69b937ec418a9c061a7e0, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4782	4500	4437	4437
q2	361	155	157	155
q3	1478	1302	1202	1202
q4	1145	986	940	940
q5	3190	3139	3170	3139
q6	260	135	136	135
q7	1036	500	486	486
q8	2242	2251	2235	2235
q9	6672	6662	6704	6662
q10	3221	3294	3275	3275
q11	329	218	211	211
q12	353	204	205	204
q13	4544	3779	3770	3770
q14	244	216	212	212
q15	568	521	508	508
q16	442	386	388	386
q17	1052	775	554	554
q18	7028	6807	6916	6807
q19	1630	1624	1621	1621
q20	564	318	296	296
q21	3260	2753	2718	2718
q22	363	297	314	297
Total cold run time: 44764 ms
Total hot run time: 40250 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4396	4386	4363	4363
q2	305	168	166	166
q3	3519	3498	3493	3493
q4	2432	2410	2403	2403
q5	5735	5720	5720	5720
q6	279	129	126	126
q7	2365	1856	1888	1856
q8	3601	3609	3600	3600
q9	9030	8952	8998	8952
q10	3909	4012	4002	4002
q11	486	377	389	377
q12	767	577	602	577
q13	4270	3578	3570	3570
q14	286	265	260	260
q15	567	519	522	519
q16	488	447	475	447
q17	1963	1959	1950	1950
q18	8613	8199	8322	8199
q19	1843	1848	1833	1833
q20	2254	1979	1950	1950
q21	6608	6249	6254	6249
q22	544	479	462	462
Total cold run time: 64260 ms
Total hot run time: 61074 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.61% (8584/23448)
Line Coverage: 28.67% (69766/243357)
Region Coverage: 27.64% (36056/130453)
Branch Coverage: 24.36% (18420/75618)
Coverage Report: http://coverage.selectdb-in.cc/coverage/40beffac6d71e9dc6fb69b937ec418a9c061a7e0_40beffac6d71e9dc6fb69b937ec418a9c061a7e0/report/index.html

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.60% (8584/23454)
Line Coverage: 28.66% (69772/243448)
Region Coverage: 27.64% (36068/130508)
Branch Coverage: 24.35% (18422/75644)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b51c329770415790ed9cacafc85bffc2fe92fcd3_b51c329770415790ed9cacafc85bffc2fe92fcd3/report/index.html

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.60% (8584/23454)
Line Coverage: 28.66% (69769/243449)
Region Coverage: 27.63% (36065/130508)
Branch Coverage: 24.36% (18424/75644)
Coverage Report: http://coverage.selectdb-in.cc/coverage/e7278cc6cd4fa4aa1e9d5b082fd43527af233dcd_e7278cc6cd4fa4aa1e9d5b082fd43527af233dcd/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit b51c329770415790ed9cacafc85bffc2fe92fcd3, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5002	4641	4668	4641
q2	377	138	158	138
q3	1471	1305	1251	1251
q4	1143	944	911	911
q5	3167	3131	3148	3131
q6	249	129	128	128
q7	1066	486	518	486
q8	2274	2266	2241	2241
q9	6750	6671	6690	6671
q10	3215	3268	3264	3264
q11	336	198	216	198
q12	350	209	203	203
q13	4159	3426	3411	3411
q14	238	218	214	214
q15	574	527	516	516
q16	451	388	385	385
q17	1043	771	604	604
q18	7100	6719	6776	6719
q19	1615	1636	1644	1636
q20	571	334	323	323
q21	3209	2733	2731	2731
q22	361	302	307	302
Total cold run time: 44721 ms
Total hot run time: 40104 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4580	4592	4571	4571
q2	274	168	168	168
q3	3369	3356	3369	3356
q4	2223	2200	2197	2197
q5	5724	5732	5723	5723
q6	242	118	119	118
q7	2370	1852	1851	1851
q8	3619	3617	3619	3617
q9	9001	8986	8920	8920
q10	3806	3892	3897	3892
q11	474	375	364	364
q12	772	602	624	602
q13	3901	3190	3212	3190
q14	295	253	269	253
q15	576	525	511	511
q16	503	459	455	455
q17	1977	1970	1963	1963
q18	8628	8113	8206	8113
q19	1753	1736	1746	1736
q20	2239	1935	1903	1903
q21	6169	5792	5766	5766
q22	549	476	472	472
Total cold run time: 63044 ms
Total hot run time: 59741 ms

@dataroaring
Copy link
Contributor

run p0 10

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit e7278cc6cd4fa4aa1e9d5b082fd43527af233dcd, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4990	4654	4614	4614
q2	360	155	159	155
q3	1469	1325	1205	1205
q4	1129	978	912	912
q5	3158	3122	3163	3122
q6	250	129	128	128
q7	1034	485	496	485
q8	2258	2263	2242	2242
q9	6733	6726	6658	6658
q10	3185	3254	3284	3254
q11	336	208	208	208
q12	347	204	202	202
q13	4160	3422	3420	3420
q14	238	214	213	213
q15	570	527	529	527
q16	446	382	385	382
q17	1048	782	616	616
q18	7066	6756	6783	6756
q19	1613	1635	1626	1626
q20	584	322	319	319
q21	3178	2634	2719	2634
q22	371	299	304	299
Total cold run time: 44523 ms
Total hot run time: 39977 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4577	4539	4561	4539
q2	268	174	171	171
q3	3377	3364	3362	3362
q4	2211	2207	2203	2203
q5	5721	5709	5724	5709
q6	239	117	121	117
q7	2376	1881	1885	1881
q8	3601	3618	3607	3607
q9	8997	8974	8991	8974
q10	3794	3886	3885	3885
q11	485	347	379	347
q12	765	598	603	598
q13	3908	3212	3218	3212
q14	280	257	261	257
q15	571	526	515	515
q16	501	448	449	448
q17	1962	1971	1948	1948
q18	8540	8278	8143	8143
q19	1766	1754	1747	1747
q20	2261	1920	1909	1909
q21	6135	5732	5761	5732
q22	555	446	457	446
Total cold run time: 62890 ms
Total hot run time: 59750 ms

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@kaijchen
Copy link
Contributor Author

run buildall

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.60% (8583/23449)
Line Coverage: 28.66% (69772/243441)
Region Coverage: 27.64% (36066/130505)
Branch Coverage: 24.35% (18423/75646)
Coverage Report: http://coverage.selectdb-in.cc/coverage/4628a3e0a8dc7de12eace866e16bf822b8e44ebe_4628a3e0a8dc7de12eace866e16bf822b8e44ebe/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit 4628a3e0a8dc7de12eace866e16bf822b8e44ebe, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5002	4629	4651	4629
q2	364	161	149	149
q3	1464	1298	1249	1249
q4	1144	955	911	911
q5	3181	3153	3159	3153
q6	247	127	127	127
q7	1026	487	500	487
q8	2297	2262	2250	2250
q9	6715	6712	6705	6705
q10	3204	3287	3275	3275
q11	338	213	199	199
q12	355	209	207	207
q13	4138	3427	3434	3427
q14	243	219	210	210
q15	573	522	523	522
q16	440	381	386	381
q17	1056	779	597	597
q18	7100	6787	6746	6746
q19	1626	1638	1636	1636
q20	559	311	312	311
q21	3219	2717	2671	2671
q22	366	312	309	309
Total cold run time: 44657 ms
Total hot run time: 40151 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4565	4573	4540	4540
q2	269	172	169	169
q3	3364	3364	3355	3355
q4	2224	2199	2208	2199
q5	5725	5716	5740	5716
q6	241	119	118	118
q7	2386	1902	1810	1810
q8	3621	3615	3623	3615
q9	9052	8949	8969	8949
q10	3780	3873	3914	3873
q11	492	371	369	369
q12	763	613	598	598
q13	3911	3191	3191	3191
q14	287	260	247	247
q15	565	527	512	512
q16	493	462	463	462
q17	1988	1952	1952	1952
q18	8616	8128	8270	8128
q19	1761	1750	1779	1750
q20	2254	1936	1920	1920
q21	6155	5748	5746	5746
q22	546	465	483	465
Total cold run time: 63058 ms
Total hot run time: 59684 ms

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.64% (8587/23433)
Line Coverage: 28.70% (69817/243301)
Region Coverage: 27.68% (36119/130465)
Branch Coverage: 24.40% (18461/75646)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f05be6626c9b86cf380e84076e94e04fc2758138_f05be6626c9b86cf380e84076e94e04fc2758138/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit f05be6626c9b86cf380e84076e94e04fc2758138, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4981	4627	4649	4627
q2	365	159	158	158
q3	1468	1256	1188	1188
q4	1132	932	911	911
q5	3144	3197	3150	3150
q6	246	126	127	126
q7	1034	556	487	487
q8	2235	2256	2245	2245
q9	6690	6683	6707	6683
q10	3187	3262	3263	3262
q11	336	212	210	210
q12	345	209	215	209
q13	4186	3465	3411	3411
q14	242	214	214	214
q15	585	513	521	513
q16	442	384	381	381
q17	1038	713	568	568
q18	7028	6821	6785	6785
q19	1640	1635	1641	1635
q20	520	314	296	296
q21	3146	2718	2697	2697
q22	360	303	299	299
Total cold run time: 44350 ms
Total hot run time: 40055 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4584	4580	4570	4570
q2	273	173	166	166
q3	3379	3383	3359	3359
q4	2216	2196	2202	2196
q5	5727	5714	5720	5714
q6	243	118	115	115
q7	2378	1866	1866	1866
q8	3613	3605	3594	3594
q9	8966	8971	8947	8947
q10	3813	3868	3892	3868
q11	497	358	369	358
q12	765	614	596	596
q13	3908	3232	3202	3202
q14	286	248	253	248
q15	578	518	510	510
q16	492	451	476	451
q17	1979	1958	1938	1938
q18	8653	8366	8324	8324
q19	1760	1750	1751	1750
q20	2234	1924	1916	1916
q21	6171	5765	5725	5725
q22	547	444	462	444
Total cold run time: 63062 ms
Total hot run time: 59857 ms

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.61% (8605/23504)
Line Coverage: 28.67% (69960/244004)
Region Coverage: 27.67% (36199/130829)
Branch Coverage: 24.38% (18503/75888)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0d8da6665eb3fb375eb9765810b740e4ee92c4a4_0d8da6665eb3fb375eb9765810b740e4ee92c4a4/report/index.html

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.69% (8652/23580)
Line Coverage: 28.73% (70485/245297)
Region Coverage: 27.66% (36411/131621)
Branch Coverage: 24.36% (18625/76450)
Coverage Report: http://coverage.selectdb-in.cc/coverage/39c49993e585b7e4418b0c10a213d01bb01e256f_39c49993e585b7e4418b0c10a213d01bb01e256f/report/index.html

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38932 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 52e545a5eae69815496960e6c1b0cbef6cbb8cc2, data reload: false

------ Round 1 ----------------------------------
q1	18236	5125	4980	4980
q2	2038	145	131	131
q3	10875	1148	1173	1148
q4	10570	823	771	771
q5	7836	3246	3221	3221
q6	207	125	125	125
q7	886	511	501	501
q8	9255	2047	2046	2046
q9	7446	6543	6513	6513
q10	8280	3126	3120	3120
q11	417	207	201	201
q12	364	191	196	191
q13	18120	3463	3396	3396
q14	266	216	219	216
q15	556	519	505	505
q16	431	380	380	380
q17	964	494	481	481
q18	7360	6907	6639	6639
q19	1595	1427	1367	1367
q20	462	319	279	279
q21	2838	2420	2478	2420
q22	350	316	301	301
Total cold run time: 109352 ms
Total hot run time: 38932 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5050	4965	4953	4953
q2	312	204	198	198
q3	3368	3319	3309	3309
q4	2257	2281	2277	2277
q5	5831	5849	5841	5841
q6	194	118	117	117
q7	2318	1896	1868	1868
q8	3489	3590	3595	3590
q9	8914	8870	8870	8870
q10	3789	3855	3875	3855
q11	560	447	438	438
q12	794	608	607	607
q13	3908	3243	3260	3243
q14	282	267	258	258
q15	571	506	518	506
q16	511	478	476	476
q17	2115	2076	2063	2063
q18	8792	8461	8400	8400
q19	1636	1599	1613	1599
q20	2183	1926	1931	1926
q21	6030	5800	5741	5741
q22	550	453	439	439
Total cold run time: 63454 ms
Total hot run time: 60574 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 179850 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 52e545a5eae69815496960e6c1b0cbef6cbb8cc2, data reload: false

query1	936	345	334	334
query2	6702	1952	1977	1952
query3	6724	209	203	203
query4	26064	22264	22081	22081
query5	5739	518	467	467
query6	278	185	187	185
query7	4623	284	278	278
query8	234	197	199	197
query9	9127	2711	2850	2711
query10	453	244	240	240
query11	16190	15252	15348	15252
query12	132	76	70	70
query13	1697	390	392	390
query14	11807	7245	7240	7240
query15	242	192	205	192
query16	6494	262	249	249
query17	1940	490	492	490
query18	1965	269	259	259
query19	294	154	149	149
query20	85	79	73	73
query21	194	134	121	121
query22	5030	4808	4565	4565
query23	31811	30939	30931	30931
query24	11160	2845	2821	2821
query25	556	333	324	324
query26	1567	151	160	151
query27	2857	280	281	280
query28	6938	1861	1841	1841
query29	1585	700	677	677
query30	285	146	139	139
query31	962	783	775	775
query32	97	67	59	59
query33	712	247	249	247
query34	971	461	470	461
query35	880	778	777	777
query36	1325	1225	1270	1225
query37	107	70	70	70
query38	3410	3317	3322	3317
query39	1338	1293	1293	1293
query40	314	103	97	97
query41	38	39	34	34
query42	104	95	92	92
query43	543	544	513	513
query44	1081	702	711	702
query45	216	184	185	184
query46	1053	667	664	664
query47	1552	1568	1580	1568
query48	400	330	324	324
query49	1140	312	313	312
query50	711	327	332	327
query51	5317	5161	5242	5161
query52	108	93	97	93
query53	356	290	289	289
query54	2073	1633	1628	1628
query55	98	90	93	90
query56	227	204	201	201
query57	1018	980	972	972
query58	218	196	205	196
query59	2765	2603	2571	2571
query60	237	213	241	213
query61	85	85	86	85
query62	589	395	398	395
query63	322	291	278	278
query64	4901	1664	1634	1634
query65	3364	3278	3286	3278
query66	1176	338	320	320
query67	15600	15378	15241	15241
query68	12367	504	527	504
query69	661	394	390	390
query70	1694	1522	1502	1502
query71	514	256	232	232
query72	4863	2826	2870	2826
query73	2520	315	311	311
query74	6981	6338	6401	6338
query75	5085	2331	2322	2322
query76	6336	1138	1155	1138
query77	689	285	282	282
query78	9799	8597	8604	8597
query79	1033	504	509	504
query80	555	355	346	346
query81	455	210	214	210
query82	217	104	90	90
query83	146	126	122	122
query84	278	79	76	76
query85	1008	353	354	353
query86	414	406	380	380
query87	3572	3363	3383	3363
query88	3272	2199	2208	2199
query89	458	399	382	382
query90	1834	212	213	212
query91	163	129	140	129
query92	65	58	55	55
query93	1069	434	407	407
query94	1249	190	185	185
query95	536	496	470	470
query96	621	318	311	311
query97	4281	4199	4150	4150
query98	217	208	194	194
query99	1031	750	722	722
Total cold run time: 293100 ms
Total hot run time: 179850 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.63 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 52e545a5eae69815496960e6c1b0cbef6cbb8cc2, data reload: false

query1	0.06	0.06	0.06
query2	0.06	0.02	0.02
query3	0.25	0.11	0.11
query4	1.78	0.12	0.12
query5	0.53	0.53	0.52
query6	1.33	0.64	0.64
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.52	0.51
query10	0.58	0.57	0.56
query11	0.13	0.09	0.09
query12	0.12	0.10	0.10
query13	0.60	0.60	0.60
query14	0.80	0.81	0.79
query15	0.84	0.81	0.82
query16	0.36	0.36	0.38
query17	1.00	0.98	0.99
query18	0.26	0.26	0.26
query19	1.88	1.72	1.75
query20	0.02	0.01	0.01
query21	15.40	0.56	0.56
query22	2.52	2.02	1.79
query23	17.18	0.81	0.73
query24	16.21	0.62	0.56
query25	2.15	0.16	0.15
query26	0.13	0.14	0.13
query27	0.15	0.15	0.16
query28	5.72	0.88	0.82
query29	12.64	3.25	3.24
query30	0.59	0.49	0.45
query31	2.78	0.36	0.36
query32	3.37	0.48	0.49
query33	3.22	3.26	3.26
query34	15.80	4.16	4.18
query35	4.13	4.16	4.21
query36	1.11	1.06	1.06
query37	0.07	0.05	0.05
query38	0.04	0.03	0.03
query39	0.02	0.02	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 114.74 s
Total hot run time: 30.63 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.71% (8651/23565)
Line Coverage: 28.73% (70471/245276)
Region Coverage: 27.65% (36413/131706)
Branch Coverage: 24.36% (18630/76470)
Coverage Report: http://coverage.selectdb-in.cc/coverage/52e545a5eae69815496960e6c1b0cbef6cbb8cc2_52e545a5eae69815496960e6c1b0cbef6cbb8cc2/report/index.html

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38788 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 88f39501039a4c82d0d5f3770818673f58de4503, data reload: false

------ Round 1 ----------------------------------
q1	17979	5073	4962	4962
q2	2040	140	136	136
q3	10674	1126	1201	1126
q4	10264	752	883	752
q5	7849	3205	3197	3197
q6	201	126	124	124
q7	877	506	500	500
q8	9262	1971	2021	1971
q9	7374	6489	6474	6474
q10	8272	3094	3050	3050
q11	414	203	204	203
q12	358	190	190	190
q13	18406	3464	3422	3422
q14	245	221	216	216
q15	556	514	512	512
q16	436	386	384	384
q17	944	529	513	513
q18	7348	6702	6657	6657
q19	1579	1403	1398	1398
q20	581	295	305	295
q21	2753	2408	2404	2404
q22	350	302	303	302
Total cold run time: 108762 ms
Total hot run time: 38788 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4988	5001	4950	4950
q2	311	203	200	200
q3	3338	3334	3299	3299
q4	2245	2257	2252	2252
q5	5826	5800	5801	5800
q6	194	115	117	115
q7	2323	1853	1863	1853
q8	3469	3584	3561	3561
q9	8843	8830	8858	8830
q10	3763	3861	3846	3846
q11	549	460	425	425
q12	789	612	604	604
q13	6185	3229	3250	3229
q14	286	266	268	266
q15	567	512	508	508
q16	506	458	466	458
q17	2073	2076	2021	2021
q18	8765	8439	8356	8356
q19	1608	1624	1588	1588
q20	2162	1960	1937	1937
q21	6145	5709	5741	5709
q22	553	462	477	462
Total cold run time: 65488 ms
Total hot run time: 60269 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 179475 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 88f39501039a4c82d0d5f3770818673f58de4503, data reload: false

query1	937	330	335	330
query2	6703	1906	1877	1877
query3	6738	203	204	203
query4	25894	22376	22136	22136
query5	5554	486	473	473
query6	294	182	193	182
query7	4617	279	276	276
query8	223	204	203	203
query9	9159	2770	2708	2708
query10	652	261	247	247
query11	16194	15380	15325	15325
query12	140	82	75	75
query13	1709	386	390	386
query14	11938	7146	7136	7136
query15	265	186	193	186
query16	6402	253	240	240
query17	1911	488	479	479
query18	1934	270	258	258
query19	298	154	155	154
query20	88	79	75	75
query21	202	124	129	124
query22	4994	4756	4703	4703
query23	31818	31120	31018	31018
query24	12217	2798	2770	2770
query25	560	337	327	327
query26	1754	153	148	148
query27	2981	272	275	272
query28	6993	1880	1855	1855
query29	2120	708	682	682
query30	291	144	136	136
query31	949	750	786	750
query32	95	60	60	60
query33	727	254	245	245
query34	1097	467	462	462
query35	937	746	727	727
query36	1350	1239	1225	1225
query37	191	70	75	70
query38	3388	3291	3280	3280
query39	1325	1287	1312	1287
query40	339	93	102	93
query41	38	37	36	36
query42	103	96	96	96
query43	549	521	483	483
query44	1058	713	713	713
query45	211	183	184	183
query46	1056	645	659	645
query47	1689	1483	1533	1483
query48	402	327	312	312
query49	1268	306	315	306
query50	707	320	322	320
query51	5298	5123	5201	5123
query52	113	89	92	89
query53	360	292	290	290
query54	2046	1588	1611	1588
query55	99	87	86	86
query56	217	210	197	197
query57	1034	968	968	968
query58	224	201	202	201
query59	2806	2533	2594	2533
query60	249	224	218	218
query61	90	87	81	81
query62	584	404	395	395
query63	310	284	285	284
query64	5703	1667	1723	1667
query65	3351	3258	3268	3258
query66	1351	330	330	330
query67	15676	15200	15315	15200
query68	12171	535	514	514
query69	655	380	391	380
query70	1742	1510	1514	1510
query71	504	249	242	242
query72	4827	2817	2825	2817
query73	2427	320	317	317
query74	6934	6435	6462	6435
query75	4931	2298	2284	2284
query76	6322	1069	1087	1069
query77	666	284	276	276
query78	9689	8581	8541	8541
query79	1035	487	486	486
query80	521	342	355	342
query81	459	209	207	207
query82	203	101	90	90
query83	143	125	123	123
query84	283	74	75	74
query85	1007	355	333	333
query86	409	367	376	367
query87	3553	3430	3392	3392
query88	3131	2197	2202	2197
query89	456	379	389	379
query90	1829	208	202	202
query91	161	124	132	124
query92	63	60	54	54
query93	993	406	397	397
query94	1280	182	178	178
query95	549	483	484	483
query96	629	315	317	315
query97	4351	4140	4187	4140
query98	207	192	188	188
query99	1055	758	751	751
Total cold run time: 295755 ms
Total hot run time: 179475 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.55 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 88f39501039a4c82d0d5f3770818673f58de4503, data reload: false

query1	0.06	0.06	0.05
query2	0.06	0.02	0.03
query3	0.25	0.12	0.11
query4	1.74	0.12	0.11
query5	0.52	0.51	0.52
query6	1.39	0.64	0.64
query7	0.02	0.01	0.02
query8	0.03	0.02	0.03
query9	0.55	0.49	0.50
query10	0.54	0.56	0.55
query11	0.13	0.09	0.09
query12	0.12	0.09	0.10
query13	0.60	0.60	0.59
query14	0.79	0.79	0.80
query15	0.81	0.82	0.80
query16	0.35	0.35	0.36
query17	0.98	0.97	0.96
query18	0.25	0.24	0.24
query19	1.86	1.73	1.79
query20	0.01	0.01	0.01
query21	15.39	0.55	0.56
query22	2.40	2.63	2.00
query23	17.18	0.87	0.69
query24	16.18	0.58	0.58
query25	2.16	0.15	0.14
query26	0.13	0.13	0.13
query27	0.15	0.15	0.15
query28	6.73	0.89	0.81
query29	12.53	3.32	3.21
query30	0.55	0.49	0.47
query31	2.78	0.35	0.35
query32	3.37	0.49	0.50
query33	3.23	3.23	3.22
query34	15.83	4.15	4.16
query35	4.17	4.15	4.16
query36	1.09	1.04	1.05
query37	0.07	0.05	0.05
query38	0.03	0.03	0.03
query39	0.02	0.02	0.01
query40	0.16	0.13	0.13
query41	0.07	0.02	0.02
query42	0.02	0.02	0.01
query43	0.03	0.01	0.02
Total cold run time: 115.33 s
Total hot run time: 30.55 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.70% (8649/23565)
Line Coverage: 28.72% (70457/245293)
Region Coverage: 27.63% (36399/131714)
Branch Coverage: 24.35% (18625/76476)
Coverage Report: http://coverage.selectdb-in.cc/coverage/88f39501039a4c82d0d5f3770818673f58de4503_88f39501039a4c82d0d5f3770818673f58de4503/report/index.html

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

2 similar comments
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38937 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 09278a71aa4f428698c88101771d64c55f81e7ca, data reload: false

------ Round 1 ----------------------------------
q1	17965	5025	4972	4972
q2	2041	140	137	137
q3	10777	1182	1203	1182
q4	10492	791	828	791
q5	7799	3265	3161	3161
q6	205	126	127	126
q7	883	520	502	502
q8	9272	2006	2053	2006
q9	7422	6568	6499	6499
q10	8260	3106	3078	3078
q11	423	218	213	213
q12	364	196	201	196
q13	18116	3489	3518	3489
q14	244	215	214	214
q15	562	516	510	510
q16	432	378	384	378
q17	958	527	565	527
q18	7515	6702	6750	6702
q19	1609	1280	1449	1280
q20	594	334	287	287
q21	2855	2380	2415	2380
q22	354	307	309	307
Total cold run time: 109142 ms
Total hot run time: 38937 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4974	4940	4963	4940
q2	320	203	206	203
q3	3362	3333	3310	3310
q4	2264	2276	2266	2266
q5	5883	5826	5850	5826
q6	197	119	121	119
q7	2327	1857	1861	1857
q8	3483	3567	3595	3567
q9	8943	8831	8849	8831
q10	3750	3827	3846	3827
q11	543	445	437	437
q12	795	611	596	596
q13	6340	3249	3275	3249
q14	296	267	266	266
q15	567	517	522	517
q16	508	462	456	456
q17	2083	2064	2059	2059
q18	8883	8506	8387	8387
q19	1624	1636	1637	1636
q20	2203	1954	1938	1938
q21	6107	5789	5666	5666
q22	559	479	480	479
Total cold run time: 66011 ms
Total hot run time: 60432 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 178132 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 09278a71aa4f428698c88101771d64c55f81e7ca, data reload: false

query1	924	335	334	334
query2	3764	1897	1952	1897
query3	6692	204	208	204
query4	26434	22115	22178	22115
query5	5706	590	557	557
query6	281	189	183	183
query7	4614	280	279	279
query8	232	215	206	206
query9	9100	2835	2765	2765
query10	561	244	238	238
query11	16197	15449	15328	15328
query12	122	85	70	70
query13	1695	391	388	388
query14	10885	7232	7192	7192
query15	243	188	200	188
query16	5518	259	245	245
query17	1888	500	487	487
query18	1827	272	264	264
query19	287	147	151	147
query20	79	77	72	72
query21	180	125	119	119
query22	5057	4858	4733	4733
query23	32071	30945	31017	30945
query24	12376	2894	2752	2752
query25	543	339	330	330
query26	1537	150	160	150
query27	2943	281	269	269
query28	7234	1882	1863	1863
query29	1481	684	675	675
query30	256	141	140	140
query31	980	783	783	783
query32	100	66	61	61
query33	732	256	257	256
query34	1141	469	478	469
query35	849	728	741	728
query36	1423	1247	1237	1237
query37	154	72	73	72
query38	3412	3277	3296	3277
query39	1315	1294	1297	1294
query40	301	97	94	94
query41	38	39	34	34
query42	111	98	100	98
query43	571	510	520	510
query44	1075	719	723	719
query45	209	179	186	179
query46	1057	644	659	644
query47	1649	1594	1439	1439
query48	395	312	326	312
query49	1096	319	324	319
query50	693	319	324	319
query51	5299	5251	5130	5130
query52	104	93	95	93
query53	356	307	298	298
query54	919	458	474	458
query55	92	83	83	83
query56	214	201	196	196
query57	1019	953	939	939
query58	210	198	203	198
query59	2687	2563	2567	2563
query60	247	215	239	215
query61	88	82	82	82
query62	631	392	397	392
query63	292	288	281	281
query64	5069	1687	1643	1643
query65	3342	3257	3278	3257
query66	1379	333	316	316
query67	15661	15121	15027	15027
query68	12537	526	532	526
query69	686	384	375	375
query70	1684	1561	1507	1507
query71	525	244	236	236
query72	5179	2811	2792	2792
query73	2775	312	320	312
query74	6965	6441	6372	6372
query75	5424	2299	2275	2275
query76	5905	934	1064	934
query77	684	275	267	267
query78	9879	8736	8553	8553
query79	1029	510	493	493
query80	523	344	347	344
query81	446	207	208	207
query82	195	90	92	90
query83	140	120	121	120
query84	283	72	76	72
query85	1030	332	324	324
query86	396	351	363	351
query87	3556	3414	3412	3412
query88	3065	2222	2219	2219
query89	436	390	387	387
query90	1988	198	194	194
query91	154	142	129	129
query92	64	61	54	54
query93	1253	425	441	425
query94	1254	182	181	181
query95	520	485	480	480
query96	615	311	314	311
query97	4270	4193	4155	4155
query98	204	188	188	188
query99	981	697	708	697
Total cold run time: 290282 ms
Total hot run time: 178132 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.17 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 09278a71aa4f428698c88101771d64c55f81e7ca, data reload: false

query1	0.06	0.05	0.06
query2	0.06	0.03	0.02
query3	0.24	0.11	0.11
query4	1.78	0.12	0.11
query5	0.52	0.52	0.51
query6	1.39	0.64	0.64
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.55	0.50	0.49
query10	0.56	0.55	0.54
query11	0.13	0.09	0.09
query12	0.12	0.10	0.09
query13	0.60	0.60	0.60
query14	0.78	0.80	0.79
query15	0.83	0.81	0.79
query16	0.35	0.36	0.34
query17	0.98	0.99	1.00
query18	0.26	0.24	0.24
query19	1.83	1.79	1.73
query20	0.01	0.01	0.01
query21	15.43	0.58	0.58
query22	2.45	2.66	2.53
query23	17.41	0.84	0.80
query24	16.06	0.62	0.60
query25	2.16	0.15	0.15
query26	0.13	0.13	0.14
query27	0.14	0.15	0.14
query28	7.17	0.84	0.82
query29	12.60	3.18	3.20
query30	0.52	0.49	0.45
query31	2.78	0.36	0.35
query32	3.40	0.48	0.49
query33	3.22	3.18	3.28
query34	16.07	4.13	4.16
query35	4.16	4.16	4.20
query36	1.10	1.05	1.06
query37	0.07	0.05	0.05
query38	0.03	0.03	0.02
query39	0.02	0.02	0.02
query40	0.16	0.13	0.13
query41	0.07	0.01	0.02
query42	0.03	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 116.32 s
Total hot run time: 31.17 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.71% (8649/23562)
Line Coverage: 28.72% (70440/245238)
Region Coverage: 27.65% (36414/131712)
Branch Coverage: 24.36% (18624/76462)
Coverage Report: http://coverage.selectdb-in.cc/coverage/09278a71aa4f428698c88101771d64c55f81e7ca_09278a71aa4f428698c88101771d64c55f81e7ca/report/index.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants