Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[debug](don't merge) test memtable on sink node 60s timeout #29118

Closed
wants to merge 4 commits into from

Conversation

kaijchen
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@kaijchen kaijchen changed the title [debug](don't merge) test memtable on sink node 10s [debug](don't merge) test memtable on sink node 20s timeout Dec 27, 2023
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@kaijchen
Copy link
Contributor Author

run p0 10

@dataroaring
Copy link
Contributor

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit 002b2b30ca6bd596e2af2397543cf9b0ee6045cd, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4765	4447	4448	4447
q2	364	160	150	150
q3	1480	1357	1331	1331
q4	1152	1001	968	968
q5	3183	3187	3144	3144
q6	261	135	135	135
q7	1049	518	485	485
q8	2260	2264	2243	2243
q9	6758	6676	6677	6676
q10	3217	3287	3284	3284
q11	331	209	200	200
q12	353	201	202	201
q13	4549	3771	3798	3771
q14	241	216	213	213
q15	571	523	522	522
q16	438	389	390	389
q17	1039	798	585	585
q18	7049	6801	6804	6801
q19	1630	1663	1684	1663
q20	572	295	303	295
q21	3248	2752	2739	2739
q22	362	304	305	304
Total cold run time: 44872 ms
Total hot run time: 40546 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4377	4401	4365	4365
q2	271	172	173	172
q3	3521	3503	3493	3493
q4	2434	2420	2417	2417
q5	5724	5719	5744	5719
q6	248	127	126	126
q7	2374	1842	1864	1842
q8	3615	3625	3608	3608
q9	9048	8947	8988	8947
q10	3944	4011	4005	4005
q11	492	360	381	360
q12	781	607	614	607
q13	4290	3574	3547	3547
q14	296	251	271	251
q15	569	521	520	520
q16	503	445	489	445
q17	1960	1957	1946	1946
q18	8707	8175	8357	8175
q19	1848	1849	1848	1848
q20	2273	1960	1941	1941
q21	6627	6223	6237	6223
q22	560	478	472	472
Total cold run time: 64462 ms
Total hot run time: 61029 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.98 seconds
stream load tsv: 570 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 20.8 seconds inserted 10000000 Rows, about 480K ops/s
storage size: 17184049491 Bytes

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.61% (8584/23448)
Line Coverage: 28.67% (69771/243357)
Region Coverage: 27.64% (36057/130455)
Branch Coverage: 24.36% (18422/75618)
Coverage Report: http://coverage.selectdb-in.cc/coverage/002b2b30ca6bd596e2af2397543cf9b0ee6045cd_002b2b30ca6bd596e2af2397543cf9b0ee6045cd/report/index.html

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.59% (8581/23454)
Line Coverage: 28.65% (69747/243448)
Region Coverage: 27.63% (36055/130510)
Branch Coverage: 24.34% (18415/75644)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7c68d24d2bcaaf0f07fbd507a623c7310c9f324e_7c68d24d2bcaaf0f07fbd507a623c7310c9f324e/report/index.html

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.78 seconds
stream load tsv: 578 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 20.7 seconds inserted 10000000 Rows, about 483K ops/s
storage size: 17183636988 Bytes

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.60% (8583/23454)
Line Coverage: 28.66% (69773/243449)
Region Coverage: 27.64% (36070/130510)
Branch Coverage: 24.35% (18423/75644)
Coverage Report: http://coverage.selectdb-in.cc/coverage/46244b05a62b7dc88f70e098531eab643f4c6c97_46244b05a62b7dc88f70e098531eab643f4c6c97/report/index.html

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.86 seconds
stream load tsv: 576 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 20.8 seconds inserted 10000000 Rows, about 480K ops/s
storage size: 17188926149 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit 7c68d24d2bcaaf0f07fbd507a623c7310c9f324e, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4975	4640	4628	4628
q2	379	145	158	145
q3	1456	1340	1226	1226
q4	1130	943	916	916
q5	3182	3163	3155	3155
q6	247	127	126	126
q7	1003	491	502	491
q8	2306	2265	2258	2258
q9	6698	6695	6694	6694
q10	3196	3281	3250	3250
q11	324	201	208	201
q12	343	202	202	202
q13	4146	3445	3389	3389
q14	241	208	215	208
q15	562	520	526	520
q16	449	387	382	382
q17	1045	793	585	585
q18	7129	6819	6969	6819
q19	1651	1659	1642	1642
q20	968	308	321	308
q21	3198	2692	2705	2692
q22	365	291	306	291
Total cold run time: 44993 ms
Total hot run time: 40128 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4557	4557	4561	4557
q2	271	170	173	170
q3	3379	3364	3341	3341
q4	2234	2208	2194	2194
q5	5718	5721	5742	5721
q6	239	118	117	117
q7	2387	1870	1855	1855
q8	3607	3621	3608	3608
q9	8940	8996	8969	8969
q10	3822	3896	3881	3881
q11	498	365	369	365
q12	767	614	604	604
q13	3889	3196	3212	3196
q14	280	250	269	250
q15	575	512	522	512
q16	522	448	449	448
q17	1978	1963	1942	1942
q18	8679	8147	8323	8147
q19	1765	1764	1754	1754
q20	2261	1950	1945	1945
q21	6145	5747	5763	5747
q22	541	452	458	452
Total cold run time: 63054 ms
Total hot run time: 59775 ms

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit 46244b05a62b7dc88f70e098531eab643f4c6c97, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5008	4630	4609	4609
q2	357	145	158	145
q3	1468	1289	1207	1207
q4	1149	986	919	919
q5	3165	3174	3170	3170
q6	247	130	125	125
q7	1044	493	495	493
q8	2291	2257	2256	2256
q9	6742	6681	6692	6681
q10	3176	3276	3249	3249
q11	333	202	214	202
q12	346	206	209	206
q13	4117	3467	3440	3440
q14	246	215	209	209
q15	565	525	526	525
q16	444	388	394	388
q17	1036	748	544	544
q18	7063	6882	6854	6854
q19	1640	1635	1632	1632
q20	537	319	311	311
q21	3161	2653	2713	2653
q22	360	296	298	296
Total cold run time: 44495 ms
Total hot run time: 40114 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4603	4554	4563	4554
q2	271	165	171	165
q3	3380	3371	3369	3369
q4	2219	2204	2202	2202
q5	5725	5731	5729	5729
q6	240	116	117	116
q7	2370	1839	1871	1839
q8	3609	3619	3615	3615
q9	9013	8997	8971	8971
q10	3795	3885	3887	3885
q11	493	369	380	369
q12	776	587	607	587
q13	3928	3191	3176	3176
q14	284	256	251	251
q15	575	527	526	526
q16	501	464	464	464
q17	1984	1978	1976	1976
q18	8678	8339	8229	8229
q19	1761	1756	1755	1755
q20	2252	1939	1925	1925
q21	6138	5797	5764	5764
q22	556	462	454	454
Total cold run time: 63151 ms
Total hot run time: 59921 ms

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@kaijchen kaijchen changed the title [debug](don't merge) test memtable on sink node 20s timeout [debug](don't merge) test memtable on sink node 60s timeout Dec 27, 2023
@kaijchen
Copy link
Contributor Author

run buildall

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.60% (8583/23449)
Line Coverage: 28.66% (69764/243441)
Region Coverage: 27.64% (36069/130505)
Branch Coverage: 24.35% (18422/75646)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c875e9c1fd5b7fe4c24d50238cf691b5bd2a5c9e_c875e9c1fd5b7fe4c24d50238cf691b5bd2a5c9e/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit c875e9c1fd5b7fe4c24d50238cf691b5bd2a5c9e, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5013	4655	4638	4638
q2	363	161	159	159
q3	1470	1310	1258	1258
q4	1135	978	958	958
q5	3183	3165	3178	3165
q6	248	126	128	126
q7	1018	488	514	488
q8	2276	2257	2266	2257
q9	6761	6679	6667	6667
q10	3195	3285	3281	3281
q11	338	216	197	197
q12	348	211	210	210
q13	4169	3432	3407	3407
q14	241	214	219	214
q15	580	524	528	524
q16	434	380	389	380
q17	1046	812	593	593
q18	7009	6793	6920	6793
q19	1638	1651	1638	1638
q20	556	324	346	324
q21	3157	2705	2719	2705
q22	366	305	315	305
Total cold run time: 44544 ms
Total hot run time: 40287 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4579	4603	4575	4575
q2	272	166	164	164
q3	3375	3367	3361	3361
q4	2230	2201	2203	2201
q5	5712	5719	5719	5719
q6	242	120	117	117
q7	2386	1875	1873	1873
q8	3600	3616	3613	3613
q9	8977	8955	8928	8928
q10	3784	3899	3893	3893
q11	502	354	359	354
q12	758	605	610	605
q13	3908	3199	3179	3179
q14	291	251	251	251
q15	566	522	518	518
q16	504	470	460	460
q17	1992	1972	1945	1945
q18	8648	8129	8297	8129
q19	1763	1758	1766	1758
q20	2226	1932	1925	1925
q21	6122	5734	5738	5734
q22	540	459	474	459
Total cold run time: 62977 ms
Total hot run time: 59761 ms

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

github-actions bot commented Jan 3, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 56558047da45259815fa3c19c24c01e62b4ad13e, data reload: false

------ Round 1 ----------------------------------
q1	17640	5595	5180	5180
q2	2015	155	141	141
q3	10544	1037	1108	1037
q4	10186	837	800	800
q5	7786	2929	2908	2908
q6	215	136	131	131
q7	910	560	500	500
q8	9269	1985	2013	1985
q9	6884	6395	6324	6324
q10	8249	3003	3004	3003
q11	420	225	220	220
q12	386	230	237	230
q13	18018	3596	3648	3596
q14	236	207	211	207
q15	581	533	519	519
q16	489	403	414	403
q17	953	533	491	491
q18	7350	6686	6639	6639
q19	1583	1425	1396	1396
q20	688	363	338	338
q21	2749	2382	2384	2382
q22	363	333	321	321
Total cold run time: 107514 ms
Total hot run time: 38751 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5111	5037	5030	5030
q2	339	234	250	234
q3	3298	3279	3251	3251
q4	2131	2000	1999	1999
q5	5785	5785	5746	5746
q6	207	122	125	122
q7	2296	1935	1888	1888
q8	3383	3447	3446	3446
q9	8785	8779	8746	8746
q10	3801	3813	3859	3813
q11	571	492	485	485
q12	816	640	653	640
q13	6463	3170	3183	3170
q14	292	276	259	259
q15	609	545	526	526
q16	542	537	501	501
q17	1914	1782	1745	1745
q18	8747	8366	8275	8275
q19	1629	1578	1568	1568
q20	2197	1947	1954	1947
q21	5587	5274	5226	5226
q22	589	454	512	454
Total cold run time: 65092 ms
Total hot run time: 59071 ms

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 56558047da45259815fa3c19c24c01e62b4ad13e, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5537	5145	5220	5145
q2	403	161	160	160
q3	1464	1178	1179	1178
q4	1110	840	833	833
q5	3078	3065	3143	3065
q6	245	138	132	132
q7	992	550	518	518
q8	2164	2197	2294	2197
q9	6696	6684	6674	6674
q10	3214	3163	3125	3125
q11	355	213	227	213
q12	383	240	236	236
q13	4428	3696	3657	3657
q14	245	225	226	225
q15	616	550	546	546
q16	457	422	436	422
q17	1045	459	498	459
q18	7117	6764	6756	6756
q19	1646	1514	1476	1476
q20	606	368	337	337
q21	2884	2527	2466	2466
q22	389	317	330	317
Total cold run time: 45074 ms
Total hot run time: 40137 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5170	5120	5100	5100
q2	348	261	279	261
q3	3394	3335	3308	3308
q4	2170	2054	2012	2012
q5	5993	5947	5935	5935
q6	231	126	128	126
q7	2413	1959	1933	1933
q8	3605	3670	3694	3670
q9	9101	8992	9088	8992
q10	3874	3944	3926	3926
q11	592	491	483	483
q12	820	663	646	646
q13	3877	3232	3222	3222
q14	301	274	281	274
q15	606	539	539	539
q16	568	504	551	504
q17	2067	1856	1819	1819
q18	8821	8437	8394	8394
q19	1760	1681	1705	1681
q20	2303	2020	1977	1977
q21	5760	5374	5350	5350
q22	575	494	523	494
Total cold run time: 64349 ms
Total hot run time: 60646 ms

@doris-robot
Copy link

TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools

TPC-DS sf100 test result on commit 56558047da45259815fa3c19c24c01e62b4ad13e, data reload: false

run tpcds-sf100 query with default conf and session variables
query1	920	351	333	333
query2	6429	1965	1871	1871
query3	6647	206	200	200
query4	27008	22463	22449	22449
query5	5093	535	522	522
query6	277	190	181	181
query7	4580	285	259	259
query8	226	206	206	206
query9	8346	2643	2570	2570
query10	420	238	262	238
query11	16272	15708	15588	15588
query12	137	76	78	76
query13	1668	340	331	331
query14	12576	7150	7082	7082
query15	242	184	183	183
query16	6484	280	265	265
query17	1819	486	495	486
query18	1929	276	267	267
query19	272	139	134	134
query20	80	80	77	77
query21	181	96	92	92
query22	5213	5060	4878	4878
query23	32202	31233	31348	31233
query24	11977	2843	2812	2812
query25	570	366	348	348
query26	1671	148	145	145
query27	2825	279	276	276
query28	7051	1957	1947	1947
query29	2018	401	398	398
query30	275	140	146	140
query31	994	761	762	761
query32	87	58	57	57
query33	727	278	258	258
query34	912	439	447	439
query35	899	763	760	760
query36	1324	1234	1202	1202
query37	179	74	69	69
query38	3412	3290	3266	3266
query39	1345	1276	1275	1275
query40	312	93	100	93
query41	47	35	37	35
query42	98	87	90	87
query43	513	473	490	473
query44	1045	709	716	709
query45	194	191	182	182
query46	1089	634	626	626
query47	1700	1506	1582	1506
query48	336	259	264	259
query49	1204	327	327	327
query50	787	365	359	359
query51	5354	5263	5285	5263
query52	86	90	82	82
query53	212	149	151	149
query54	1399	569	585	569
query55	98	98	90	90
query56	205	197	199	197
query57	1020	918	978	918
query58	221	204	204	204
query59	2785	2547	2545	2545
query60	281	243	260	243
query61	87	84	83	83
query62	634	491	451	451
query63	163	151	143	143
query64	5951	1676	1691	1676
query65	3314	3249	3297	3249
query66	1309	342	326	326
query67	15830	15478	15148	15148
query68	11266	534	515	515
query69	523	246	251	246
query70	1697	1534	1433	1433
query71	494	233	237	233
query72	5628	3585	3562	3562
query73	2206	312	312	312
query74	6953	6445	6453	6445
query75	4791	2327	2265	2265
query76	6266	1113	1090	1090
query77	653	276	249	249
query78	9092	8915	8697	8697
query79	1048	524	509	509
query80	585	385	378	378
query81	475	210	208	208
query82	214	103	105	103
query83	160	135	140	135
query84	243	56	55	55
query85	934	296	274	274
query86	389	388	358	358
query87	3575	3369	3402	3369
query88	2897	2258	2267	2258
query89	355	263	267	263
query90	1893	205	216	205
query91	122	95	101	95
query92	59	52	53	52
query93	2492	502	494	494
query94	795	185	196	185
query95	477	407	408	407
query96	635	316	321	316
query97	4272	4142	4151	4142
query98	201	201	188	188
query99	1120	835	795	795
Total cold run time: 294071 ms
Total hot run time: 179502 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.62% (8615/23524)
Line Coverage: 28.67% (70004/244160)
Region Coverage: 27.65% (36231/131022)
Branch Coverage: 24.35% (18510/76014)
Coverage Report: http://coverage.selectdb-in.cc/coverage/56558047da45259815fa3c19c24c01e62b4ad13e_56558047da45259815fa3c19c24c01e62b4ad13e/report/index.html

@kaijchen
Copy link
Contributor Author

kaijchen commented Jan 9, 2024

run buildall

Copy link
Contributor

github-actions bot commented Jan 9, 2024

clang-tidy review says "All clean, LGTM! 👍"

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@kaijchen
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39065 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3c4a9034bc5e3fa63153a1b0045d96b42c29e623, data reload: false

------ Round 1 ----------------------------------
q1	17656	5293	5345	5293
q2	2043	149	134	134
q3	10802	1141	1157	1141
q4	10437	758	792	758
q5	7725	3174	3151	3151
q6	200	121	122	121
q7	849	492	476	476
q8	9217	1963	1976	1963
q9	7502	6434	6386	6386
q10	8211	3093	3094	3093
q11	419	213	201	201
q12	356	190	199	190
q13	18998	3483	3403	3403
q14	252	211	225	211
q15	556	509	507	507
q16	499	372	380	372
q17	951	547	522	522
q18	7629	6877	6893	6877
q19	1578	1318	1375	1318
q20	590	327	291	291
q21	2739	2338	2419	2338
q22	351	323	319	319
Total cold run time: 109560 ms
Total hot run time: 39065 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5562	5331	5319	5319
q2	344	239	232	232
q3	3596	3463	3423	3423
q4	2346	2258	2193	2193
q5	6237	6280	6305	6280
q6	207	142	149	142
q7	2526	1898	1934	1898
q8	3263	3396	3405	3396
q9	9102	8807	8790	8790
q10	3945	3831	3843	3831
q11	547	473	453	453
q12	811	605	640	605
q13	16888	3159	3147	3147
q14	286	261	273	261
q15	558	505	506	505
q16	532	454	463	454
q17	1858	1804	1821	1804
q18	9710	16859	9633	9633
q19	27042	1629	1537	1537
q20	4582	1949	1944	1944
q21	14437	5399	5473	5399
q22	976	555	561	555
Total cold run time: 115355 ms
Total hot run time: 61801 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186347 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3c4a9034bc5e3fa63153a1b0045d96b42c29e623, data reload: false

query1	949	342	337	337
query2	6541	2043	1912	1912
query3	6703	205	196	196
query4	30652	22231	22007	22007
query5	4451	373	369	369
query6	250	168	158	158
query7	4616	253	270	253
query8	228	172	171	171
query9	8383	2530	2510	2510
query10	424	234	232	232
query11	17197	15597	15796	15597
query12	120	72	69	69
query13	1677	398	371	371
query14	10508	7007	6956	6956
query15	224	184	189	184
query16	5783	256	249	249
query17	950	469	469	469
query18	1794	268	245	245
query19	174	133	130	130
query20	74	74	68	68
query21	183	134	130	130
query22	4972	4840	4737	4737
query23	31786	30901	30661	30661
query24	12203	2818	2807	2807
query25	565	306	304	304
query26	1652	140	142	140
query27	3217	283	289	283
query28	7268	1821	1813	1813
query29	1716	609	630	609
query30	286	138	137	137
query31	941	728	768	728
query32	86	50	50	50
query33	700	210	210	210
query34	1144	451	469	451
query35	879	771	758	758
query36	1316	1163	1206	1163
query37	97	60	59	59
query38	3400	3194	3199	3194
query39	1317	1260	1261	1260
query40	348	90	83	83
query41	37	37	34	34
query42	93	80	90	80
query43	518	482	484	482
query44	1066	682	691	682
query45	193	176	169	169
query46	1070	650	661	650
query47	1617	1579	1594	1579
query48	384	310	303	303
query49	1171	294	280	280
query50	676	305	324	305
query51	5325	5189	5197	5189
query52	94	75	82	75
query53	320	273	254	254
query54	245	179	183	179
query55	81	81	76	76
query56	180	173	170	170
query57	1014	957	953	953
query58	189	165	160	160
query59	2973	2822	2846	2822
query60	210	183	189	183
query61	83	85	79	79
query62	590	367	367	367
query63	284	251	263	251
query64	6076	1816	1725	1725
query65	3332	3278	3275	3275
query66	1278	317	305	305
query67	15687	15080	15501	15080
query68	11869	528	519	519
query69	608	288	295	288
query70	1682	1545	1438	1438
query71	10488	10202	10196	10196
query72	4919	2812	2783	2783
query73	2113	316	317	316
query74	6936	6305	6291	6291
query75	4842	2332	2310	2310
query76	6707	1075	1058	1058
query77	657	230	229	229
query78	9361	8724	8600	8600
query79	989	490	505	490
query80	576	328	317	317
query81	449	206	200	200
query82	198	84	79	79
query83	139	113	116	113
query84	278	68	69	68
query85	1113	338	347	338
query86	392	374	381	374
query87	3489	3322	3333	3322
query88	3115	2221	2196	2196
query89	448	342	341	341
query90	1973	191	184	184
query91	170	136	143	136
query92	57	45	44	44
query93	2247	448	411	411
query94	1223	157	159	157
query95	501	443	438	438
query96	637	331	321	321
query97	4228	4146	4139	4139
query98	204	193	186	186
query99	1017	700	698	698
Total cold run time: 304185 ms
Total hot run time: 186347 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.81 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3c4a9034bc5e3fa63153a1b0045d96b42c29e623, data reload: false

query1	0.04	0.02	0.02
query2	0.06	0.02	0.02
query3	0.23	0.05	0.04
query4	1.67	0.06	0.07
query5	0.53	0.53	0.52
query6	1.33	0.64	0.63
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.54	0.50	0.50
query10	0.55	0.56	0.55
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.61	0.60	0.61
query14	0.78	0.80	0.79
query15	0.81	0.78	0.77
query16	0.38	0.36	0.37
query17	1.00	1.04	1.00
query18	0.23	0.25	0.23
query19	1.79	1.79	1.78
query20	0.01	0.01	0.01
query21	15.40	0.56	0.56
query22	2.42	2.26	2.74
query23	17.49	0.87	0.80
query24	2.58	0.38	1.37
query25	0.42	0.24	0.15
query26	0.44	0.14	0.13
query27	0.05	0.07	0.06
query28	11.93	0.77	0.76
query29	12.52	3.20	3.20
query30	0.56	0.54	0.48
query31	2.77	0.35	0.36
query32	3.35	0.49	0.48
query33	3.20	3.21	3.28
query34	15.72	4.37	4.30
query35	4.30	4.32	4.28
query36	1.11	1.07	1.07
query37	0.07	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.02	0.02
query42	0.02	0.01	0.02
query43	0.03	0.01	0.01
Total cold run time: 105.51 s
Total hot run time: 30.81 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 3c4a9034bc5e3fa63153a1b0045d96b42c29e623 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       13.8 seconds inserted 10000000 Rows, about 724K ops/s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.76% (8667/23579)
Line Coverage: 28.73% (70754/246308)
Region Coverage: 27.61% (36460/132056)
Branch Coverage: 24.33% (18658/76684)
Coverage Report: http://coverage.selectdb-in.cc/coverage/3c4a9034bc5e3fa63153a1b0045d96b42c29e623_3c4a9034bc5e3fa63153a1b0045d96b42c29e623/report/index.html

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38908 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fd1d1f34b07786d7b1a8fcdaee6d3e1033e8dee4, data reload: false

------ Round 1 ----------------------------------
q1	17690	5301	5488	5301
q2	2032	135	128	128
q3	10826	1184	1204	1184
q4	10416	764	801	764
q5	7727	3184	3157	3157
q6	198	122	122	122
q7	859	488	473	473
q8	9242	1937	1936	1936
q9	7301	6400	6326	6326
q10	8170	3029	3008	3008
q11	400	216	202	202
q12	357	190	192	190
q13	17983	3365	3357	3357
q14	242	223	215	215
q15	542	512	501	501
q16	431	371	371	371
q17	940	544	560	544
q18	7429	7083	6825	6825
q19	1671	1272	1404	1272
q20	606	315	291	291
q21	2749	2477	2441	2441
q22	365	300	304	300
Total cold run time: 108176 ms
Total hot run time: 38908 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5292	5132	5259	5132
q2	328	217	212	212
q3	3338	3228	3218	3218
q4	2085	2000	2009	2000
q5	6023	5902	5927	5902
q6	194	115	115	115
q7	2336	1803	1896	1803
q8	3222	3362	3387	3362
q9	8877	8786	8848	8786
q10	3866	3862	3783	3783
q11	540	453	449	449
q12	786	624	591	591
q13	16908	3163	3187	3163
q14	277	266	263	263
q15	546	506	499	499
q16	515	453	482	453
q17	1860	1819	1812	1812
q18	9602	18736	9819	9819
q19	24548	1553	1513	1513
q20	4614	1941	1924	1924
q21	14504	5329	5395	5329
q22	1018	553	536	536
Total cold run time: 111279 ms
Total hot run time: 60664 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186027 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fd1d1f34b07786d7b1a8fcdaee6d3e1033e8dee4, data reload: false

query1	933	335	329	329
query2	6575	2024	2052	2024
query3	6727	205	197	197
query4	31175	22098	22191	22098
query5	4451	370	364	364
query6	241	156	151	151
query7	4603	267	260	260
query8	219	175	181	175
query9	8320	2582	2587	2582
query10	426	222	250	222
query11	16978	15444	15513	15444
query12	119	71	66	66
query13	1693	381	376	376
query14	10494	7021	6973	6973
query15	213	186	183	183
query16	5789	257	247	247
query17	954	474	474	474
query18	1794	259	245	245
query19	179	130	131	130
query20	70	70	67	67
query21	199	132	127	127
query22	4892	4685	4761	4685
query23	31760	30713	30858	30713
query24	12836	2790	2888	2790
query25	567	307	296	296
query26	1834	144	138	138
query27	3380	286	284	284
query28	7415	1828	1826	1826
query29	2207	625	622	622
query30	284	134	141	134
query31	952	723	768	723
query32	71	52	46	46
query33	706	217	214	214
query34	1310	460	471	460
query35	904	799	766	766
query36	1338	1201	1238	1201
query37	179	59	61	59
query38	3370	3246	3236	3236
query39	1337	1276	1281	1276
query40	345	85	84	84
query41	40	36	35	35
query42	92	80	86	80
query43	533	481	470	470
query44	1117	696	696	696
query45	192	177	177	177
query46	1101	644	648	644
query47	1686	1562	1531	1531
query48	388	314	307	307
query49	1235	298	278	278
query50	693	316	316	316
query51	5303	5156	5205	5156
query52	87	83	75	75
query53	322	249	254	249
query54	251	175	176	175
query55	76	79	77	77
query56	178	163	161	161
query57	1030	953	942	942
query58	184	149	153	149
query59	2931	2810	2805	2805
query60	202	177	181	177
query61	79	86	78	78
query62	619	366	365	365
query63	287	253	266	253
query64	6086	1768	1745	1745
query65	3325	3266	3253	3253
query66	1455	310	308	308
query67	15579	14909	15002	14909
query68	14136	533	496	496
query69	608	302	286	286
query70	2328	1502	1484	1484
query71	10478	10194	10195	10194
query72	4853	2833	2833	2833
query73	3722	312	316	312
query74	6975	6329	6312	6312
query75	5171	2296	2304	2296
query76	6718	1015	980	980
query77	744	223	241	223
query78	9607	8605	8441	8441
query79	2542	493	506	493
query80	563	311	310	310
query81	448	200	204	200
query82	202	78	77	77
query83	168	116	111	111
query84	275	71	69	69
query85	1082	325	325	325
query86	388	373	379	373
query87	3530	3274	3362	3274
query88	3242	2188	2195	2188
query89	423	351	365	351
query90	2127	187	181	181
query91	160	121	137	121
query92	50	43	43	43
query93	1508	431	440	431
query94	1348	163	157	157
query95	502	455	458	455
query96	620	314	314	314
query97	4242	4101	4135	4101
query98	211	191	192	191
query99	1011	721	707	707
Total cold run time: 312892 ms
Total hot run time: 186027 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.87 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fd1d1f34b07786d7b1a8fcdaee6d3e1033e8dee4, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.02
query3	0.24	0.06	0.05
query4	1.65	0.08	0.08
query5	0.55	0.52	0.52
query6	1.30	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.51	0.49
query10	0.58	0.57	0.56
query11	0.12	0.09	0.09
query12	0.11	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.81	0.82
query15	0.80	0.78	0.77
query16	0.36	0.37	0.37
query17	1.01	1.01	1.02
query18	0.22	0.26	0.24
query19	1.86	1.75	1.78
query20	0.02	0.01	0.01
query21	15.40	0.57	0.59
query22	2.44	2.60	1.83
query23	17.42	0.83	0.77
query24	2.75	0.93	0.91
query25	0.39	0.14	0.18
query26	0.59	0.13	0.13
query27	0.06	0.06	0.06
query28	11.43	0.82	0.80
query29	12.55	3.18	3.10
query30	0.55	0.44	0.48
query31	2.78	0.35	0.34
query32	3.35	0.49	0.49
query33	3.23	3.26	3.26
query34	15.70	4.28	4.34
query35	4.34	4.25	4.36
query36	1.12	1.06	1.08
query37	0.07	0.05	0.05
query38	0.04	0.02	0.03
query39	0.02	0.02	0.02
query40	0.16	0.13	0.13
query41	0.07	0.01	0.02
query42	0.03	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 105.46 s
Total hot run time: 30.87 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit fd1d1f34b07786d7b1a8fcdaee6d3e1033e8dee4 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.6 seconds inserted 10000000 Rows, about 735K ops/s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants