Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](ctx) manager the lifecycle of connection context #29346

Merged
merged 3 commits into from
Jan 1, 2024

Conversation

morningman
Copy link
Contributor

Proposed changes

In FrontendService, we may create some connection context and set it as a thread local varaible.
These context should be removed from thread local after call.
Otherwise, it may be reused by other thread incorrectly.

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@morningman
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 6edf9ce7af2e15f847a24e7794eb0f6b3a596a84, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5405	5179	5199	5179
q2	390	163	166	163
q3	1468	1198	1134	1134
q4	1085	770	786	770
q5	3160	3132	3080	3080
q6	224	131	140	131
q7	974	549	544	544
q8	2158	2197	2226	2197
q9	6709	6648	6664	6648
q10	3191	3208	3182	3182
q11	340	215	206	206
q12	380	231	235	231
q13	4400	3633	3642	3633
q14	251	221	204	204
q15	627	546	553	546
q16	455	424	392	392
q17	1052	546	524	524
q18	7062	6785	6783	6783
q19	1639	1530	1527	1527
q20	628	336	357	336
q21	2905	2447	2531	2447
q22	375	319	317	317
Total cold run time: 44878 ms
Total hot run time: 40174 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5151	5124	5071	5071
q2	340	275	244	244
q3	3361	3293	3276	3276
q4	2154	2022	2017	2017
q5	5942	5933	5948	5933
q6	230	126	127	126
q7	2368	1958	1878	1878
q8	3586	3713	3681	3681
q9	9027	8968	9001	8968
q10	3901	3903	3908	3903
q11	588	475	492	475
q12	813	634	631	631
q13	3881	3207	3188	3188
q14	300	300	287	287
q15	618	541	540	540
q16	574	508	522	508
q17	2031	1796	1790	1790
q18	8739	8308	8344	8308
q19	1738	1689	1741	1689
q20	2294	1992	1991	1991
q21	5727	5340	5232	5232
q22	543	521	521	521
Total cold run time: 63906 ms
Total hot run time: 60257 ms

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit 6edf9ce7af2e15f847a24e7794eb0f6b3a596a84, data reload: false

------ Round 1 ----------------------------------
q1	17636	5079	5145	5079
q2	2020	155	148	148
q3	10539	1116	1128	1116
q4	10196	829	844	829
q5	7786	2943	2889	2889
q6	206	132	132	132
q7	916	538	502	502
q8	9305	1977	1986	1977
q9	6812	6341	6353	6341
q10	8238	3072	2971	2971
q11	432	204	222	204
q12	391	236	231	231
q13	18006	3667	3658	3658
q14	253	214	206	206
q15	590	544	531	531
q16	453	397	411	397
q17	943	463	474	463
q18	7306	6663	6637	6637
q19	1587	1408	1297	1297
q20	694	329	343	329
q21	2786	2371	2407	2371
q22	364	321	344	321
Total cold run time: 107459 ms
Total hot run time: 38629 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5203	5111	5130	5111
q2	333	265	260	260
q3	3299	3258	3278	3258
q4	2111	2007	2031	2007
q5	5758	5768	5754	5754
q6	213	127	126	126
q7	2326	1871	1886	1871
q8	3360	3434	3453	3434
q9	8757	8726	8732	8726
q10	3789	3830	3835	3830
q11	591	507	488	488
q12	810	644	658	644
q13	6487	3229	3240	3229
q14	293	278	273	273
q15	595	535	534	534
q16	561	515	491	491
q17	1915	1759	1760	1759
q18	8649	8284	8306	8284
q19	1620	1601	1592	1592
q20	2188	1974	1955	1955
q21	5499	5331	5242	5242
q22	542	514	502	502
Total cold run time: 64899 ms
Total hot run time: 59370 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.91 seconds
stream load tsv: 561 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.3 seconds inserted 10000000 Rows, about 353K ops/s
storage size: 17183426933 Bytes

@doris-robot
Copy link

TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools

TPC-DS sf100 test result on commit 6edf9ce7af2e15f847a24e7794eb0f6b3a596a84, data reload: false

run tpcds-sf100 query with default conf and session variables
query1	940	349	338	338
query2	6418	1962	1936	1936
query3	6645	203	208	203
query4	26838	22374	22253	22253
query5	3907	511	530	511
query6	271	193	187	187
query7	4573	264	274	264
query8	224	208	198	198
query9	8157	2609	2657	2609
query10	437	257	247	247
query11	16286	15731	15654	15654
query12	134	79	81	79
query13	1624	329	329	329
query14	11697	7173	7231	7173
query15	240	188	200	188
query16	6514	278	277	277
query17	1856	501	498	498
query18	1965	263	279	263
query19	279	141	134	134
query20	84	75	78	75
query21	189	97	93	93
query22	4919	4911	4820	4820
query23	32327	31388	31236	31236
query24	11072	2814	2834	2814
query25	582	360	342	342
query26	1314	140	144	140
query27	2836	278	280	278
query28	6843	1997	1981	1981
query29	1114	404	395	395
query30	288	143	146	143
query31	986	775	776	775
query32	88	64	65	64
query33	724	278	272	272
query34	841	444	445	444
query35	925	758	752	752
query36	1386	1182	1256	1182
query37	105	78	73	73
query38	3448	3254	3282	3254
query39	1339	1285	1280	1280
query40	184	96	93	93
query41	39	35	35	35
query42	98	99	93	93
query43	511	499	517	499
query44	1147	719	717	717
query45	201	190	191	190
query46	1083	652	637	637
query47	1698	1624	1618	1618
query48	335	264	269	264
query49	1086	332	323	323
query50	709	333	365	333
query51	5456	5229	5341	5229
query52	91	88	88	88
query53	216	151	153	151
query54	1402	554	600	554
query55	100	85	92	85
query56	212	201	204	201
query57	1007	975	949	949
query58	219	210	208	208
query59	2754	2654	2685	2654
query60	243	237	240	237
query61	85	83	84	83
query62	674	489	479	479
query63	171	148	153	148
query64	4963	1712	1758	1712
query65	3337	3288	3300	3288
query66	1114	333	328	328
query67	15785	15125	15237	15125
query68	12635	518	506	506
query69	511	254	257	254
query70	1744	1519	1557	1519
query71	509	229	229	229
query72	5599	3523	3514	3514
query73	2849	317	312	312
query74	7064	6472	6383	6383
query75	5364	2283	2231	2231
query76	6315	1058	1176	1058
query77	657	289	299	289
query78	9120	8826	8559	8559
query79	1046	520	509	509
query80	557	379	361	361
query81	470	208	213	208
query82	211	98	100	98
query83	163	134	136	134
query84	248	53	51	51
query85	919	277	271	271
query86	390	370	401	370
query87	3599	3367	3365	3365
query88	2986	2245	2249	2245
query89	333	279	289	279
query90	1888	203	215	203
query91	118	90	89	89
query92	62	58	57	57
query93	1409	440	491	440
query94	809	195	192	192
query95	472	429	411	411
query96	610	314	312	312
query97	4281	4142	4214	4142
query98	209	189	184	184
query99	1090	850	835	835
Total cold run time: 289572 ms
Total hot run time: 179685 ms

dataroaring
dataroaring previously approved these changes Dec 31, 2023
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 31, 2023
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@morningman
Copy link
Contributor Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Dec 31, 2023
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit f9b20166a42680d6b03bee135332ce926863928e, data reload: false

------ Round 1 ----------------------------------
q1	17660	5181	5076	5076
q2	2019	154	144	144
q3	10544	1082	1087	1082
q4	10183	773	843	773
q5	7788	2926	2784	2784
q6	211	131	129	129
q7	932	539	496	496
q8	9284	2007	1999	1999
q9	6786	6372	6371	6371
q10	8222	3058	3021	3021
q11	438	220	222	220
q12	381	231	232	231
q13	18012	3624	3641	3624
q14	239	216	210	210
q15	564	535	547	535
q16	465	388	414	388
q17	940	487	525	487
q18	7270	6688	6626	6626
q19	1592	1421	1320	1320
q20	706	340	344	340
q21	2766	2378	2365	2365
q22	377	325	327	325
Total cold run time: 107379 ms
Total hot run time: 38546 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5211	5130	5082	5082
q2	340	257	256	256
q3	3318	3270	3255	3255
q4	2102	1974	2014	1974
q5	5804	5786	5793	5786
q6	210	123	126	123
q7	2330	1921	1898	1898
q8	3365	3445	3446	3445
q9	8765	8761	8776	8761
q10	3793	3845	3852	3845
q11	594	488	489	488
q12	801	620	645	620
q13	7752	3226	3225	3225
q14	315	268	274	268
q15	602	538	535	535
q16	549	510	511	510
q17	1934	1759	1764	1759
q18	8598	8268	8090	8090
q19	1604	1533	1558	1533
q20	2199	1961	1958	1958
q21	5571	5275	5174	5174
q22	536	521	461	461
Total cold run time: 66293 ms
Total hot run time: 59046 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.62% (8612/23514)
Line Coverage: 28.66% (69951/244063)
Region Coverage: 27.67% (36228/130940)
Branch Coverage: 24.37% (18510/75966)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f9b20166a42680d6b03bee135332ce926863928e_f9b20166a42680d6b03bee135332ce926863928e/report/index.html

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit f9b20166a42680d6b03bee135332ce926863928e, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5529	5178	5130	5130
q2	382	170	153	153
q3	1462	1156	1258	1156
q4	1092	882	835	835
q5	3152	3133	3020	3020
q6	225	132	133	132
q7	1002	557	509	509
q8	2129	2246	2252	2246
q9	6699	6668	6650	6650
q10	3150	3120	3152	3120
q11	330	219	212	212
q12	387	237	235	235
q13	4422	3667	3604	3604
q14	255	214	220	214
q15	609	563	536	536
q16	465	407	432	407
q17	1038	536	522	522
q18	7065	6720	6772	6720
q19	1631	1491	1415	1415
q20	597	382	333	333
q21	2900	2443	2430	2430
q22	399	312	334	312
Total cold run time: 44920 ms
Total hot run time: 39891 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5123	5044	5091	5044
q2	330	268	245	245
q3	3362	3320	3268	3268
q4	2144	2033	2007	2007
q5	5965	5913	5961	5913
q6	226	127	127	127
q7	2397	1914	1941	1914
q8	3543	3649	3662	3649
q9	9035	9014	8916	8916
q10	3867	3923	3919	3919
q11	584	497	490	490
q12	848	640	612	612
q13	3833	3193	3192	3192
q14	299	283	276	276
q15	613	551	552	551
q16	533	497	505	497
q17	2033	1814	1794	1794
q18	8756	8255	8329	8255
q19	1737	1673	1698	1673
q20	2281	1993	1981	1981
q21	5628	5329	5227	5227
q22	558	508	504	504
Total cold run time: 63695 ms
Total hot run time: 60054 ms

@doris-robot
Copy link

TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools

TPC-DS sf100 test result on commit f9b20166a42680d6b03bee135332ce926863928e, data reload: false

run tpcds-sf100 query with default conf and session variables
query1	931	353	335	335
query2	6432	1964	1992	1964
query3	6646	213	207	207
query4	26382	22404	22457	22404
query5	5035	502	557	502
query6	277	194	186	186
query7	4576	285	268	268
query8	230	205	204	204
query9	8233	2551	2551	2551
query10	443	273	235	235
query11	16176	15599	15475	15475
query12	144	79	76	76
query13	1647	324	334	324
query14	12018	7267	7120	7120
query15	248	193	195	193
query16	6464	279	271	271
query17	1808	516	498	498
query18	1951	272	258	258
query19	225	154	138	138
query20	85	80	81	80
query21	184	99	97	97
query22	4820	4903	4572	4572
query23	31806	31194	31310	31194
query24	11938	2813	2762	2762
query25	585	349	348	348
query26	1678	144	148	144
query27	2813	288	296	288
query28	6935	1956	1956	1956
query29	2064	406	381	381
query30	298	145	153	145
query31	996	803	774	774
query32	88	64	60	60
query33	734	284	276	276
query34	915	444	447	444
query35	906	776	726	726
query36	1328	1196	1332	1196
query37	189	76	79	76
query38	3380	3355	3252	3252
query39	1308	1304	1267	1267
query40	308	95	89	89
query41	37	36	34	34
query42	96	91	92	91
query43	526	468	492	468
query44	1056	710	716	710
query45	202	189	184	184
query46	1084	646	650	646
query47	1713	1565	1643	1565
query48	341	258	269	258
query49	1203	329	330	329
query50	736	332	372	332
query51	5436	5282	5263	5263
query52	105	87	88	87
query53	215	145	153	145
query54	1408	571	604	571
query55	98	86	93	86
query56	217	208	210	208
query57	1043	955	963	955
query58	223	215	212	212
query59	2793	2570	2487	2487
query60	247	235	237	235
query61	89	86	86	86
query62	643	447	488	447
query63	168	150	149	149
query64	5888	1744	1705	1705
query65	3347	3250	3264	3250
query66	1315	339	333	333
query67	15671	15675	14996	14996
query68	10418	544	524	524
query69	526	271	253	253
query70	1769	1521	1397	1397
query71	483	237	240	237
query72	5426	3547	3575	3547
query73	2195	315	319	315
query74	6965	6383	6438	6383
query75	4617	2260	2301	2260
query76	6207	1119	1140	1119
query77	657	300	279	279
query78	9102	8684	8663	8663
query79	1025	518	506	506
query80	552	379	376	376
query81	461	209	206	206
query82	215	106	101	101
query83	168	139	138	138
query84	243	56	55	55
query85	925	317	283	283
query86	388	382	388	382
query87	3571	3337	3352	3337
query88	3471	2252	2283	2252
query89	342	264	277	264
query90	1831	217	215	215
query91	124	90	102	90
query92	64	56	57	56
query93	1336	502	502	502
query94	788	195	197	195
query95	486	415	419	415
query96	627	318	323	318
query97	4282	4165	4156	4156
query98	221	208	198	198
query99	1109	841	854	841
Total cold run time: 289718 ms
Total hot run time: 179031 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.52 seconds
stream load tsv: 566 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 28.3 seconds inserted 10000000 Rows, about 353K ops/s
storage size: 17183942945 Bytes

@morningman
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit f189131c9e137b2aac62c71cd48cabd27bd7aae3, data reload: false

------ Round 1 ----------------------------------
q1	17644	5148	5152	5148
q2	2011	156	147	147
q3	10546	1077	1156	1077
q4	10173	819	783	783
q5	7796	2900	2805	2805
q6	215	131	128	128
q7	892	546	515	515
q8	9324	1995	1959	1959
q9	6819	6397	6374	6374
q10	8208	3028	3053	3028
q11	430	229	220	220
q12	387	235	232	232
q13	18008	3637	3618	3618
q14	244	206	214	206
q15	585	545	533	533
q16	458	403	401	401
q17	955	502	492	492
q18	7260	6664	6598	6598
q19	1561	1286	1423	1286
q20	674	335	367	335
q21	2795	2351	2370	2351
q22	373	332	325	325
Total cold run time: 107358 ms
Total hot run time: 38561 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5137	5139	5059	5059
q2	338	239	274	239
q3	3315	3250	3250	3250
q4	2118	2030	2046	2030
q5	5791	5776	5744	5744
q6	212	122	122	122
q7	2340	1883	1869	1869
q8	3342	3436	3433	3433
q9	8766	8777	8694	8694
q10	3775	3835	3844	3835
q11	588	522	509	509
q12	797	632	644	632
q13	7968	3211	3215	3211
q14	295	269	267	267
q15	599	543	527	527
q16	568	504	508	504
q17	1918	1737	1775	1737
q18	8615	8347	8261	8261
q19	1612	1575	1594	1575
q20	2213	1947	1974	1947
q21	5519	5288	5133	5133
q22	526	484	447	447
Total cold run time: 66352 ms
Total hot run time: 59025 ms

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools

Tpch sf100 test result on commit f189131c9e137b2aac62c71cd48cabd27bd7aae3, data reload: false

run tpch-sf100 query with default conf and session variables
q1	5450	5178	5168	5168
q2	392	162	167	162
q3	1454	1240	1151	1151
q4	1077	852	798	798
q5	3105	3097	3128	3097
q6	221	137	132	132
q7	982	566	530	530
q8	2154	2204	2301	2204
q9	6714	6657	6644	6644
q10	3164	3076	3139	3076
q11	346	210	222	210
q12	385	235	238	235
q13	4402	3640	3631	3631
q14	252	221	221	221
q15	620	560	552	552
q16	468	394	407	394
q17	1039	559	500	500
q18	7118	6735	6794	6735
q19	1630	1542	1429	1429
q20	574	347	345	345
q21	2846	2487	2416	2416
q22	378	325	314	314
Total cold run time: 44771 ms
Total hot run time: 39944 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	5145	5109	5091	5091
q2	336	232	259	232
q3	3358	3293	3253	3253
q4	2175	1989	2035	1989
q5	5933	5907	5908	5907
q6	227	126	127	126
q7	2405	1945	1901	1901
q8	3545	3670	3667	3667
q9	9053	8999	8946	8946
q10	3859	3897	3948	3897
q11	589	486	493	486
q12	802	635	657	635
q13	3889	3210	3251	3210
q14	308	279	300	279
q15	614	559	552	552
q16	564	525	537	525
q17	2040	1829	1797	1797
q18	8776	8372	8513	8372
q19	1734	1641	1718	1641
q20	2278	2016	1982	1982
q21	5733	5251	5281	5251
q22	579	554	519	519
Total cold run time: 63942 ms
Total hot run time: 60258 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.62% (8612/23520)
Line Coverage: 28.67% (69982/244096)
Region Coverage: 27.66% (36220/130966)
Branch Coverage: 24.36% (18506/75980)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f189131c9e137b2aac62c71cd48cabd27bd7aae3_f189131c9e137b2aac62c71cd48cabd27bd7aae3/report/index.html

@doris-robot
Copy link

TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools

TPC-DS sf100 test result on commit f189131c9e137b2aac62c71cd48cabd27bd7aae3, data reload: false

run tpcds-sf100 query with default conf and session variables
query1	919	347	337	337
query2	6449	1942	1985	1942
query3	6642	207	201	201
query4	26863	22514	22571	22514
query5	6019	519	543	519
query6	280	188	186	186
query7	4590	275	275	275
query8	236	209	196	196
query9	8284	2587	2508	2508
query10	447	276	265	265
query11	16196	15651	15552	15552
query12	135	80	76	76
query13	1670	330	328	328
query14	12177	7176	7088	7088
query15	238	187	196	187
query16	6343	299	281	281
query17	1768	498	501	498
query18	1952	277	262	262
query19	286	141	138	138
query20	86	78	83	78
query21	189	97	95	95
query22	5007	4795	4740	4740
query23	31941	31271	31272	31271
query24	10714	2856	2818	2818
query25	579	365	350	350
query26	1364	152	149	149
query27	2856	284	281	281
query28	6966	1966	1964	1964
query29	1094	397	405	397
query30	289	140	143	140
query31	992	754	779	754
query32	90	64	58	58
query33	716	279	274	274
query34	835	444	440	440
query35	848	767	777	767
query36	1368	1253	1341	1253
query37	109	79	80	79
query38	3388	3351	3322	3322
query39	1329	1279	1278	1278
query40	183	93	95	93
query41	40	35	34	34
query42	97	89	99	89
query43	519	480	485	480
query44	1087	711	727	711
query45	198	191	185	185
query46	1053	666	661	661
query47	1732	1585	1617	1585
query48	341	259	259	259
query49	1082	328	325	325
query50	732	359	326	326
query51	5448	5245	5291	5245
query52	101	84	94	84
query53	223	156	147	147
query54	1395	590	581	581
query55	104	88	87	87
query56	216	207	204	204
query57	970	948	977	948
query58	237	215	210	210
query59	2704	2615	2563	2563
query60	253	231	239	231
query61	88	85	91	85
query62	672	447	440	440
query63	177	152	151	151
query64	4886	1780	1731	1731
query65	3350	3276	3273	3273
query66	948	338	330	330
query67	15470	15857	15635	15635
query68	11130	539	526	526
query69	521	262	262	262
query70	1736	1614	1555	1555
query71	502	240	234	234
query72	5749	3580	3570	3570
query73	2188	317	313	313
query74	7059	6440	6336	6336
query75	4817	2286	2266	2266
query76	6287	1087	1121	1087
query77	675	285	308	285
query78	9146	8837	8568	8568
query79	1310	504	490	490
query80	661	384	369	369
query81	491	211	209	209
query82	180	111	102	102
query83	161	139	135	135
query84	245	54	58	54
query85	960	286	289	286
query86	403	394	406	394
query87	3573	3413	3366	3366
query88	3170	2268	2274	2268
query89	363	262	270	262
query90	1851	218	208	208
query91	118	90	93	90
query92	69	56	55	55
query93	3259	442	501	442
query94	829	192	192	192
query95	479	424	427	424
query96	629	309	316	309
query97	4290	4141	4159	4141
query98	222	204	189	189
query99	1040	819	841	819
Total cold run time: 290673 ms
Total hot run time: 180360 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.12 seconds
stream load tsv: 565 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 27.5 seconds inserted 10000000 Rows, about 363K ops/s
storage size: 17183578517 Bytes

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 1, 2024
Copy link
Contributor

github-actions bot commented Jan 1, 2024

PR approved by at least one committer and no changes requested.

@morningman morningman merged commit 4cbbd25 into apache:master Jan 1, 2024
27 of 28 checks passed
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Jan 12, 2024
In FrontendService, we may create some connection context and set it as a thread local varaible.
These context should be removed from thread local after call.
Otherwise, it may be reused by other thread incorrectly.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.4 dev/3.0.0-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants