Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a simple unevaluatedProperties benchmark case #12

Merged
merged 1 commit into from
Oct 16, 2024

Conversation

jviotti
Copy link
Member

@jviotti jviotti commented Oct 16, 2024

Signed-off-by: Juan Cruz Viotti [email protected]

@jviotti jviotti force-pushed the unevaluated-properties-benchmark branch 3 times, most recently from b605544 to 67a7212 Compare October 16, 2024 20:10
@jviotti jviotti force-pushed the unevaluated-properties-benchmark branch from 67a7212 to d5dc324 Compare October 16, 2024 21:28
Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Benchmark suite Current: d5dc324 Previous: 43cac42 Ratio
Compiler_Draft6_AdaptiveCard 3038328957.9999657 ns/iter 2839266250.000037 ns/iter 1.07
Evaluator_Draft4_Meta_1_No_Callback 771.2042492419118 ns/iter 737.605867506464 ns/iter 1.05
Evaluator_Draft4_Required_Properties 988.2430764548171 ns/iter 933.1028575471629 ns/iter 1.06
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 156.88568513354824 ns/iter 151.82502265472615 ns/iter 1.03
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 106.95815647952851 ns/iter 102.49484971060625 ns/iter 1.04
Evaluator_Draft4_Items_Schema 2722.7432758457176 ns/iter 2602.693786552985 ns/iter 1.05
Evaluator_Draft4_Nested_Object 23.883355719448144 ns/iter 22.868245070601315 ns/iter 1.04
Evaluator_Draft4_Properties_Triad_Optional 1311.828081952349 ns/iter 1258.7873256785897 ns/iter 1.04
Evaluator_Draft4_Properties_Triad_Closed 1009.2145030998472 ns/iter 980.284582409077 ns/iter 1.03
Evaluator_Draft4_Properties_Triad_Required 1352.3001041223404 ns/iter 1285.6025587259812 ns/iter 1.05
Evaluator_Draft4_Non_Recursive_Ref 220.35674442860034 ns/iter 212.02978192506535 ns/iter 1.04
Evaluator_Draft4_Pattern_Properties_True 1492.5761813124304 ns/iter 1349.9486149693623 ns/iter 1.11
Evaluator_Draft4_Ref_To_Single_Property 112.3681795714526 ns/iter 105.18261477058257 ns/iter 1.07
Evaluator_Draft4_Additional_Properties_Type 424.88173873263725 ns/iter 403.46791459955523 ns/iter 1.05
Evaluator_Draft4_Nested_Oneof 381.0065124348383 ns/iter 383.7527121673974 ns/iter 0.99
Evaluator_Draft6_Property_Names 798.8673696874324 ns/iter 771.7129690663697 ns/iter 1.04
Evaluator_Draft7_If_Then_Else 176.4767270263488 ns/iter 170.2876598559202 ns/iter 1.04
Evaluator_2019_09_Unevaluated_Properties 913.7340699515014 ns/iter
Evaluator_2020_12_Dynamic_Ref 1460.555787484257 ns/iter 1436.0519579038819 ns/iter 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Benchmark suite Current: d5dc324 Previous: 43cac42 Ratio
Compiler_Draft6_AdaptiveCard 5242672667.000022 ns/iter 5228062936.000015 ns/iter 1.00
Evaluator_Draft4_Meta_1_No_Callback 991.9121306965786 ns/iter 1033.7866236554148 ns/iter 0.96
Evaluator_Draft4_Required_Properties 1647.1360633605636 ns/iter 1640.1618954905716 ns/iter 1.00
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 184.19790202176168 ns/iter 185.1824980352819 ns/iter 0.99
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 130.68730772378782 ns/iter 134.02205058657552 ns/iter 0.98
Evaluator_Draft4_Items_Schema 3470.6078447966365 ns/iter 3781.9372400264165 ns/iter 0.92
Evaluator_Draft4_Nested_Object 33.15184900126638 ns/iter 33.745273248204214 ns/iter 0.98
Evaluator_Draft4_Properties_Triad_Optional 1833.766958311136 ns/iter 1854.5627949980221 ns/iter 0.99
Evaluator_Draft4_Properties_Triad_Closed 1490.5423905858045 ns/iter 1503.0807077807206 ns/iter 0.99
Evaluator_Draft4_Properties_Triad_Required 1898.792363855195 ns/iter 1911.1249045175166 ns/iter 0.99
Evaluator_Draft4_Non_Recursive_Ref 481.23055908831356 ns/iter 502.64887246910786 ns/iter 0.96
Evaluator_Draft4_Pattern_Properties_True 2450.0829718788723 ns/iter 2513.850841899807 ns/iter 0.97
Evaluator_Draft4_Ref_To_Single_Property 133.58657920839303 ns/iter 134.63857085126625 ns/iter 0.99
Evaluator_Draft4_Additional_Properties_Type 603.2413772913304 ns/iter 579.3017194742072 ns/iter 1.04
Evaluator_Draft4_Nested_Oneof 476.8679259157091 ns/iter 522.2351283647723 ns/iter 0.91
Evaluator_Draft6_Property_Names 1202.4940038860323 ns/iter 1259.8643449539347 ns/iter 0.95
Evaluator_Draft7_If_Then_Else 207.41129785759543 ns/iter 221.80497862011256 ns/iter 0.94
Evaluator_2019_09_Unevaluated_Properties 1162.5213156085144 ns/iter
Evaluator_2020_12_Dynamic_Ref 1851.9678900778792 ns/iter 1928.1363796859007 ns/iter 0.96

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Benchmark suite Current: d5dc324 Previous: 43cac42 Ratio
Evaluator_2020_12_Dynamic_Ref 1783.4737148340614 ns/iter 1812.840782403886 ns/iter 0.98
Evaluator_2019_09_Unevaluated_Properties 1110.3689906653076 ns/iter
Evaluator_Draft7_If_Then_Else 209.88488083019004 ns/iter 211.1279369505754 ns/iter 0.99
Evaluator_Draft6_Property_Names 1559.4548139131175 ns/iter 1601.6956317658414 ns/iter 0.97
Evaluator_Draft4_Meta_1_No_Callback 1065.8024136695183 ns/iter 1079.1385738981508 ns/iter 0.99
Evaluator_Draft4_Required_Properties 2251.562072538873 ns/iter 2302.422634134075 ns/iter 0.98
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 192.10010250608116 ns/iter 199.17295736068263 ns/iter 0.96
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 134.3164615565507 ns/iter 138.25217780227118 ns/iter 0.97
Evaluator_Draft4_Items_Schema 3170.4040164081466 ns/iter 3164.467036333215 ns/iter 1.00
Evaluator_Draft4_Nested_Object 36.17926807366854 ns/iter 23.977831581069676 ns/iter 1.51
Evaluator_Draft4_Properties_Triad_Optional 1708.2642603247732 ns/iter 1711.7862625728374 ns/iter 1.00
Evaluator_Draft4_Properties_Triad_Closed 1438.6306227965863 ns/iter 1428.8901821063575 ns/iter 1.01
Evaluator_Draft4_Properties_Triad_Required 1785.6017289319457 ns/iter 1809.1232985060467 ns/iter 0.99
Evaluator_Draft4_Non_Recursive_Ref 443.94578657994947 ns/iter 462.4116080898283 ns/iter 0.96
Evaluator_Draft4_Pattern_Properties_True 2387.2801885370886 ns/iter 2332.761344054227 ns/iter 1.02
Evaluator_Draft4_Ref_To_Single_Property 139.14206582699583 ns/iter 140.73235194510582 ns/iter 0.99
Evaluator_Draft4_Additional_Properties_Type 1053.1064504142844 ns/iter 1096.6849407597501 ns/iter 0.96
Evaluator_Draft4_Nested_Oneof 439.7972039590169 ns/iter 451.38391008215285 ns/iter 0.97
Compiler_Draft6_AdaptiveCard 5773575718.99995 ns/iter 5730000387.000018 ns/iter 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (windows/msvc)

Benchmark suite Current: d5dc324 Previous: 43cac42 Ratio
Compiler_Draft6_AdaptiveCard 10426265700.000044 ns/iter 10470733800.000061 ns/iter 1.00
Evaluator_Draft4_Meta_1_No_Callback 2303.6531249999825 ns/iter 2310.03391737298 ns/iter 1.00
Evaluator_Draft4_Required_Properties 1981.1101617055797 ns/iter 2008.2976655109776 ns/iter 0.99
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 536.0591964286447 ns/iter 541.7575999999826 ns/iter 0.99
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 416.905396566747 ns/iter 407.24534264994116 ns/iter 1.02
Evaluator_Draft4_Items_Schema 6545.59709821407 ns/iter 6639.763392857593 ns/iter 0.99
Evaluator_Draft4_Nested_Object 161.6645758928519 ns/iter 153.18462053571633 ns/iter 1.06
Evaluator_Draft4_Properties_Triad_Optional 5362.6223214280335 ns/iter 5442.687500000431 ns/iter 0.99
Evaluator_Draft4_Properties_Triad_Closed 4386.575624999978 ns/iter 4472.435801997817 ns/iter 0.98
Evaluator_Draft4_Properties_Triad_Required 5409.930000000712 ns/iter 5520.414000000074 ns/iter 0.98
Evaluator_Draft4_Non_Recursive_Ref 543.9053999999716 ns/iter 552.6563999999325 ns/iter 0.98
Evaluator_Draft4_Pattern_Properties_True 7907.945312499721 ns/iter 8172.433035714529 ns/iter 0.97
Evaluator_Draft4_Ref_To_Single_Property 410.9147633780256 ns/iter 409.5982001603843 ns/iter 1.00
Evaluator_Draft4_Additional_Properties_Type 757.0584821429296 ns/iter 745.0222098215013 ns/iter 1.02
Evaluator_Draft4_Nested_Oneof 1065.9831250000807 ns/iter 1086.624531250102 ns/iter 0.98
Evaluator_Draft6_Property_Names 2006.7504316411125 ns/iter 1981.0308759203378 ns/iter 1.01
Evaluator_Draft7_If_Then_Else 567.4976999999899 ns/iter 563.3554464286103 ns/iter 1.01
Evaluator_2019_09_Unevaluated_Properties 3122.1959821431865 ns/iter
Evaluator_2020_12_Dynamic_Ref 4775.124721260338 ns/iter 4742.029256276576 ns/iter 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/gcc)

Benchmark suite Current: d5dc324 Previous: 43cac42 Ratio
Compiler_Draft6_AdaptiveCard 4233768939.971924 ns/iter 3671083927.154541 ns/iter 1.15
Evaluator_Draft4_Meta_1_No_Callback 833.284242622635 ns/iter 763.7515074144736 ns/iter 1.09
Evaluator_Draft4_Required_Properties 1097.3076506454884 ns/iter 1013.3954979184487 ns/iter 1.08
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 187.67649971152963 ns/iter 180.81787344142472 ns/iter 1.04
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 130.0000226709474 ns/iter 124.03888857067489 ns/iter 1.05
Evaluator_Draft4_Items_Schema 2626.082544526034 ns/iter 2410.414754903225 ns/iter 1.09
Evaluator_Draft4_Nested_Object 26.646021931916163 ns/iter 24.801662816960054 ns/iter 1.07
Evaluator_Draft4_Properties_Triad_Optional 1634.4651549353505 ns/iter 1530.5790639235222 ns/iter 1.07
Evaluator_Draft4_Properties_Triad_Closed 1411.0311677719615 ns/iter 1310.5181317473864 ns/iter 1.08
Evaluator_Draft4_Properties_Triad_Required 1718.3529126731462 ns/iter 1584.5960594945038 ns/iter 1.08
Evaluator_Draft4_Non_Recursive_Ref 467.94154227831206 ns/iter 418.62781392242226 ns/iter 1.12
Evaluator_Draft4_Pattern_Properties_True 2124.6438878830554 ns/iter 1964.1128516934816 ns/iter 1.08
Evaluator_Draft4_Ref_To_Single_Property 127.12068482300354 ns/iter 117.68935828911631 ns/iter 1.08
Evaluator_Draft4_Additional_Properties_Type 505.51509857177734 ns/iter 479.81175152575065 ns/iter 1.05
Evaluator_Draft4_Nested_Oneof 395.3809376374793 ns/iter 379.4678958020304 ns/iter 1.04
Evaluator_Draft6_Property_Names 975.665113813136 ns/iter 932.5194394971468 ns/iter 1.05
Evaluator_Draft7_If_Then_Else 197.83832910894657 ns/iter 182.40527561563596 ns/iter 1.08
Evaluator_2019_09_Unevaluated_Properties 873.2852653005984 ns/iter
Evaluator_2020_12_Dynamic_Ref 1669.8719197961564 ns/iter 1561.218951563206 ns/iter 1.07

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit 9de9e57 into main Oct 16, 2024
14 checks passed
@jviotti jviotti deleted the unevaluated-properties-benchmark branch October 16, 2024 21:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant