-
-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add a simple unevaluatedProperties
benchmark case
#12
Conversation
b605544
to
67a7212
Compare
Signed-off-by: Juan Cruz Viotti <[email protected]>
67a7212
to
d5dc324
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (macos/llvm)
Benchmark suite | Current: d5dc324 | Previous: 43cac42 | Ratio |
---|---|---|---|
Compiler_Draft6_AdaptiveCard |
3038328957.9999657 ns/iter |
2839266250.000037 ns/iter |
1.07 |
Evaluator_Draft4_Meta_1_No_Callback |
771.2042492419118 ns/iter |
737.605867506464 ns/iter |
1.05 |
Evaluator_Draft4_Required_Properties |
988.2430764548171 ns/iter |
933.1028575471629 ns/iter |
1.06 |
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match |
156.88568513354824 ns/iter |
151.82502265472615 ns/iter |
1.03 |
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match |
106.95815647952851 ns/iter |
102.49484971060625 ns/iter |
1.04 |
Evaluator_Draft4_Items_Schema |
2722.7432758457176 ns/iter |
2602.693786552985 ns/iter |
1.05 |
Evaluator_Draft4_Nested_Object |
23.883355719448144 ns/iter |
22.868245070601315 ns/iter |
1.04 |
Evaluator_Draft4_Properties_Triad_Optional |
1311.828081952349 ns/iter |
1258.7873256785897 ns/iter |
1.04 |
Evaluator_Draft4_Properties_Triad_Closed |
1009.2145030998472 ns/iter |
980.284582409077 ns/iter |
1.03 |
Evaluator_Draft4_Properties_Triad_Required |
1352.3001041223404 ns/iter |
1285.6025587259812 ns/iter |
1.05 |
Evaluator_Draft4_Non_Recursive_Ref |
220.35674442860034 ns/iter |
212.02978192506535 ns/iter |
1.04 |
Evaluator_Draft4_Pattern_Properties_True |
1492.5761813124304 ns/iter |
1349.9486149693623 ns/iter |
1.11 |
Evaluator_Draft4_Ref_To_Single_Property |
112.3681795714526 ns/iter |
105.18261477058257 ns/iter |
1.07 |
Evaluator_Draft4_Additional_Properties_Type |
424.88173873263725 ns/iter |
403.46791459955523 ns/iter |
1.05 |
Evaluator_Draft4_Nested_Oneof |
381.0065124348383 ns/iter |
383.7527121673974 ns/iter |
0.99 |
Evaluator_Draft6_Property_Names |
798.8673696874324 ns/iter |
771.7129690663697 ns/iter |
1.04 |
Evaluator_Draft7_If_Then_Else |
176.4767270263488 ns/iter |
170.2876598559202 ns/iter |
1.04 |
Evaluator_2019_09_Unevaluated_Properties |
913.7340699515014 ns/iter |
||
Evaluator_2020_12_Dynamic_Ref |
1460.555787484257 ns/iter |
1436.0519579038819 ns/iter |
1.02 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (linux/llvm)
Benchmark suite | Current: d5dc324 | Previous: 43cac42 | Ratio |
---|---|---|---|
Compiler_Draft6_AdaptiveCard |
5242672667.000022 ns/iter |
5228062936.000015 ns/iter |
1.00 |
Evaluator_Draft4_Meta_1_No_Callback |
991.9121306965786 ns/iter |
1033.7866236554148 ns/iter |
0.96 |
Evaluator_Draft4_Required_Properties |
1647.1360633605636 ns/iter |
1640.1618954905716 ns/iter |
1.00 |
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match |
184.19790202176168 ns/iter |
185.1824980352819 ns/iter |
0.99 |
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match |
130.68730772378782 ns/iter |
134.02205058657552 ns/iter |
0.98 |
Evaluator_Draft4_Items_Schema |
3470.6078447966365 ns/iter |
3781.9372400264165 ns/iter |
0.92 |
Evaluator_Draft4_Nested_Object |
33.15184900126638 ns/iter |
33.745273248204214 ns/iter |
0.98 |
Evaluator_Draft4_Properties_Triad_Optional |
1833.766958311136 ns/iter |
1854.5627949980221 ns/iter |
0.99 |
Evaluator_Draft4_Properties_Triad_Closed |
1490.5423905858045 ns/iter |
1503.0807077807206 ns/iter |
0.99 |
Evaluator_Draft4_Properties_Triad_Required |
1898.792363855195 ns/iter |
1911.1249045175166 ns/iter |
0.99 |
Evaluator_Draft4_Non_Recursive_Ref |
481.23055908831356 ns/iter |
502.64887246910786 ns/iter |
0.96 |
Evaluator_Draft4_Pattern_Properties_True |
2450.0829718788723 ns/iter |
2513.850841899807 ns/iter |
0.97 |
Evaluator_Draft4_Ref_To_Single_Property |
133.58657920839303 ns/iter |
134.63857085126625 ns/iter |
0.99 |
Evaluator_Draft4_Additional_Properties_Type |
603.2413772913304 ns/iter |
579.3017194742072 ns/iter |
1.04 |
Evaluator_Draft4_Nested_Oneof |
476.8679259157091 ns/iter |
522.2351283647723 ns/iter |
0.91 |
Evaluator_Draft6_Property_Names |
1202.4940038860323 ns/iter |
1259.8643449539347 ns/iter |
0.95 |
Evaluator_Draft7_If_Then_Else |
207.41129785759543 ns/iter |
221.80497862011256 ns/iter |
0.94 |
Evaluator_2019_09_Unevaluated_Properties |
1162.5213156085144 ns/iter |
||
Evaluator_2020_12_Dynamic_Ref |
1851.9678900778792 ns/iter |
1928.1363796859007 ns/iter |
0.96 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (linux/gcc)
Benchmark suite | Current: d5dc324 | Previous: 43cac42 | Ratio |
---|---|---|---|
Evaluator_2020_12_Dynamic_Ref |
1783.4737148340614 ns/iter |
1812.840782403886 ns/iter |
0.98 |
Evaluator_2019_09_Unevaluated_Properties |
1110.3689906653076 ns/iter |
||
Evaluator_Draft7_If_Then_Else |
209.88488083019004 ns/iter |
211.1279369505754 ns/iter |
0.99 |
Evaluator_Draft6_Property_Names |
1559.4548139131175 ns/iter |
1601.6956317658414 ns/iter |
0.97 |
Evaluator_Draft4_Meta_1_No_Callback |
1065.8024136695183 ns/iter |
1079.1385738981508 ns/iter |
0.99 |
Evaluator_Draft4_Required_Properties |
2251.562072538873 ns/iter |
2302.422634134075 ns/iter |
0.98 |
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match |
192.10010250608116 ns/iter |
199.17295736068263 ns/iter |
0.96 |
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match |
134.3164615565507 ns/iter |
138.25217780227118 ns/iter |
0.97 |
Evaluator_Draft4_Items_Schema |
3170.4040164081466 ns/iter |
3164.467036333215 ns/iter |
1.00 |
Evaluator_Draft4_Nested_Object |
36.17926807366854 ns/iter |
23.977831581069676 ns/iter |
1.51 |
Evaluator_Draft4_Properties_Triad_Optional |
1708.2642603247732 ns/iter |
1711.7862625728374 ns/iter |
1.00 |
Evaluator_Draft4_Properties_Triad_Closed |
1438.6306227965863 ns/iter |
1428.8901821063575 ns/iter |
1.01 |
Evaluator_Draft4_Properties_Triad_Required |
1785.6017289319457 ns/iter |
1809.1232985060467 ns/iter |
0.99 |
Evaluator_Draft4_Non_Recursive_Ref |
443.94578657994947 ns/iter |
462.4116080898283 ns/iter |
0.96 |
Evaluator_Draft4_Pattern_Properties_True |
2387.2801885370886 ns/iter |
2332.761344054227 ns/iter |
1.02 |
Evaluator_Draft4_Ref_To_Single_Property |
139.14206582699583 ns/iter |
140.73235194510582 ns/iter |
0.99 |
Evaluator_Draft4_Additional_Properties_Type |
1053.1064504142844 ns/iter |
1096.6849407597501 ns/iter |
0.96 |
Evaluator_Draft4_Nested_Oneof |
439.7972039590169 ns/iter |
451.38391008215285 ns/iter |
0.97 |
Compiler_Draft6_AdaptiveCard |
5773575718.99995 ns/iter |
5730000387.000018 ns/iter |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (windows/msvc)
Benchmark suite | Current: d5dc324 | Previous: 43cac42 | Ratio |
---|---|---|---|
Compiler_Draft6_AdaptiveCard |
10426265700.000044 ns/iter |
10470733800.000061 ns/iter |
1.00 |
Evaluator_Draft4_Meta_1_No_Callback |
2303.6531249999825 ns/iter |
2310.03391737298 ns/iter |
1.00 |
Evaluator_Draft4_Required_Properties |
1981.1101617055797 ns/iter |
2008.2976655109776 ns/iter |
0.99 |
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match |
536.0591964286447 ns/iter |
541.7575999999826 ns/iter |
0.99 |
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match |
416.905396566747 ns/iter |
407.24534264994116 ns/iter |
1.02 |
Evaluator_Draft4_Items_Schema |
6545.59709821407 ns/iter |
6639.763392857593 ns/iter |
0.99 |
Evaluator_Draft4_Nested_Object |
161.6645758928519 ns/iter |
153.18462053571633 ns/iter |
1.06 |
Evaluator_Draft4_Properties_Triad_Optional |
5362.6223214280335 ns/iter |
5442.687500000431 ns/iter |
0.99 |
Evaluator_Draft4_Properties_Triad_Closed |
4386.575624999978 ns/iter |
4472.435801997817 ns/iter |
0.98 |
Evaluator_Draft4_Properties_Triad_Required |
5409.930000000712 ns/iter |
5520.414000000074 ns/iter |
0.98 |
Evaluator_Draft4_Non_Recursive_Ref |
543.9053999999716 ns/iter |
552.6563999999325 ns/iter |
0.98 |
Evaluator_Draft4_Pattern_Properties_True |
7907.945312499721 ns/iter |
8172.433035714529 ns/iter |
0.97 |
Evaluator_Draft4_Ref_To_Single_Property |
410.9147633780256 ns/iter |
409.5982001603843 ns/iter |
1.00 |
Evaluator_Draft4_Additional_Properties_Type |
757.0584821429296 ns/iter |
745.0222098215013 ns/iter |
1.02 |
Evaluator_Draft4_Nested_Oneof |
1065.9831250000807 ns/iter |
1086.624531250102 ns/iter |
0.98 |
Evaluator_Draft6_Property_Names |
2006.7504316411125 ns/iter |
1981.0308759203378 ns/iter |
1.01 |
Evaluator_Draft7_If_Then_Else |
567.4976999999899 ns/iter |
563.3554464286103 ns/iter |
1.01 |
Evaluator_2019_09_Unevaluated_Properties |
3122.1959821431865 ns/iter |
||
Evaluator_2020_12_Dynamic_Ref |
4775.124721260338 ns/iter |
4742.029256276576 ns/iter |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Benchmark (macos/gcc)
Benchmark suite | Current: d5dc324 | Previous: 43cac42 | Ratio |
---|---|---|---|
Compiler_Draft6_AdaptiveCard |
4233768939.971924 ns/iter |
3671083927.154541 ns/iter |
1.15 |
Evaluator_Draft4_Meta_1_No_Callback |
833.284242622635 ns/iter |
763.7515074144736 ns/iter |
1.09 |
Evaluator_Draft4_Required_Properties |
1097.3076506454884 ns/iter |
1013.3954979184487 ns/iter |
1.08 |
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match |
187.67649971152963 ns/iter |
180.81787344142472 ns/iter |
1.04 |
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match |
130.0000226709474 ns/iter |
124.03888857067489 ns/iter |
1.05 |
Evaluator_Draft4_Items_Schema |
2626.082544526034 ns/iter |
2410.414754903225 ns/iter |
1.09 |
Evaluator_Draft4_Nested_Object |
26.646021931916163 ns/iter |
24.801662816960054 ns/iter |
1.07 |
Evaluator_Draft4_Properties_Triad_Optional |
1634.4651549353505 ns/iter |
1530.5790639235222 ns/iter |
1.07 |
Evaluator_Draft4_Properties_Triad_Closed |
1411.0311677719615 ns/iter |
1310.5181317473864 ns/iter |
1.08 |
Evaluator_Draft4_Properties_Triad_Required |
1718.3529126731462 ns/iter |
1584.5960594945038 ns/iter |
1.08 |
Evaluator_Draft4_Non_Recursive_Ref |
467.94154227831206 ns/iter |
418.62781392242226 ns/iter |
1.12 |
Evaluator_Draft4_Pattern_Properties_True |
2124.6438878830554 ns/iter |
1964.1128516934816 ns/iter |
1.08 |
Evaluator_Draft4_Ref_To_Single_Property |
127.12068482300354 ns/iter |
117.68935828911631 ns/iter |
1.08 |
Evaluator_Draft4_Additional_Properties_Type |
505.51509857177734 ns/iter |
479.81175152575065 ns/iter |
1.05 |
Evaluator_Draft4_Nested_Oneof |
395.3809376374793 ns/iter |
379.4678958020304 ns/iter |
1.04 |
Evaluator_Draft6_Property_Names |
975.665113813136 ns/iter |
932.5194394971468 ns/iter |
1.05 |
Evaluator_Draft7_If_Then_Else |
197.83832910894657 ns/iter |
182.40527561563596 ns/iter |
1.08 |
Evaluator_2019_09_Unevaluated_Properties |
873.2852653005984 ns/iter |
||
Evaluator_2020_12_Dynamic_Ref |
1669.8719197961564 ns/iter |
1561.218951563206 ns/iter |
1.07 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti [email protected]