Upgrade the JSON Schema Test Suite to 4ba013d58e747ecaf48c8bb7cf248cb0d564afbc

[jviotti]

Signed-off-by: Juan Cruz Viotti [email protected]

[github-actions]

Benchmark (linux/llvm)

Benchmark suite	Current: 98abf41	Previous: 9407a4c	Ratio
Compiler_Draft6_AdaptiveCard	72165457167 ns/iter	68610430635 ns/iter	1.05
Compiler_2019_09_OMC_JSON_V2	11409084246.000021 ns/iter	11141900609.999992 ns/iter	1.02
Evaluator_Draft4_Meta_1_No_Callback	299.3697983082938 ns/iter	303.0578070010727 ns/iter	0.99
Evaluator_Draft4_Required_Properties	622.0706947882745 ns/iter	632.7052738125706 ns/iter	0.98
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	31.92746374757716 ns/iter	32.00501107341206 ns/iter	1.00
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	13.229997526518169 ns/iter	13.244986913185713 ns/iter	1.00
Evaluator_Draft4_Items_Schema	635.3037639648243 ns/iter	616.1674659408856 ns/iter	1.03
Evaluator_Draft4_Nested_Object	4.667111681310966 ns/iter	4.664024793074444 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Optional	917.3287491431165 ns/iter	901.9657383598229 ns/iter	1.02
Evaluator_Draft4_Properties_Triad_Closed	721.314487297319 ns/iter	724.6685456686924 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Required	893.6630780582519 ns/iter	874.9197201097146 ns/iter	1.02
Evaluator_Draft4_Properties_Closed	83.36110983344112 ns/iter	83.35855266591037 ns/iter	1.00
Evaluator_Draft4_Non_Recursive_Ref	28.959202328710887 ns/iter	28.96057226905753 ns/iter	1.00
Evaluator_Draft4_Pattern_Properties_True	240.27314771755732 ns/iter	242.78838952271647 ns/iter	0.99
Evaluator_Draft4_Ref_To_Single_Property	12.957214231846415 ns/iter	13.027151535616744 ns/iter	0.99
Evaluator_Draft4_Additional_Properties_Type	53.19616853026926 ns/iter	53.31943018105743 ns/iter	1.00
Evaluator_Draft4_Nested_Oneof	85.60890770832096 ns/iter	85.61270798317331 ns/iter	1.00
Evaluator_Draft4_Short_Enum	15.882490821388483 ns/iter	16.077402607394014 ns/iter	0.99
Evaluator_Draft4_Long_Enum	20.22960041102137 ns/iter	20.242917031575537 ns/iter	1.00
Evaluator_Draft4_Long_Enum_Short_Strings	15.966922806310354 ns/iter	16.0395669546727 ns/iter	1.00
Evaluator_Draft4_Type_Object	10.276355954108185 ns/iter	10.27931056038894 ns/iter	1.00
Evaluator_Draft6_Property_Names	127.42141385961418 ns/iter	126.84379164700839 ns/iter	1.00
Evaluator_Draft7_If_Then_Else	39.69819787288756 ns/iter	39.59834314250199 ns/iter	1.00
Evaluator_Draft7_Vercel_1	47711.75547045911 ns/iter	47055.719075757435 ns/iter	1.01
Evaluator_Draft7_Helm_Chart_Lock_1	282.6604803276414 ns/iter	283.8126227558823 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_2	282.01496434645844 ns/iter	280.12904566356866 ns/iter	1.01
Evaluator_Draft7_Jasmine_1	179.19282692374827 ns/iter	177.223498385236 ns/iter	1.01
Evaluator_Draft7_Dependabot_1	1270.1968173824723 ns/iter	1247.156760862701 ns/iter	1.02
Evaluator_2019_09_Unevaluated_Properties	52.759111149057205 ns/iter	52.67749407641882 ns/iter	1.00
Evaluator_2019_09_OMC_JSON_V2_1	1451.72082548775 ns/iter	1441.1175594902875 ns/iter	1.01
Evaluator_2020_12_Dynamic_Ref	597.4893904484602 ns/iter	589.4362016895707 ns/iter	1.01
Evaluator_2020_12_Dynamic_Ref_Single	9.958124638626657 ns/iter	9.959396073654757 ns/iter	1.00
Evaluator_2020_12_CQL_1	3798.8769847280337 ns/iter	3827.3014471412175 ns/iter	0.99
Evaluator_2020_12_OpenAPI	208712.9145199104 ns/iter	201359.60571751604 ns/iter	1.04

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Benchmark suite	Current: 98abf41	Previous: 9407a4c	Ratio
Compiler_Draft6_AdaptiveCard	53729903708.00005 ns/iter	61987159958.99994 ns/iter	0.87
Compiler_2019_09_OMC_JSON_V2	10009603792.000008 ns/iter	9618133833.000002 ns/iter	1.04
Evaluator_Draft4_Meta_1_No_Callback	194.95520649322592 ns/iter	185.82155540414192 ns/iter	1.05
Evaluator_Draft4_Required_Properties	460.8643361178531 ns/iter	417.76701045051226 ns/iter	1.10
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	21.76965255796504 ns/iter	21.831487828815696 ns/iter	1.00
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	9.004331149350156 ns/iter	8.33530327260861 ns/iter	1.08
Evaluator_Draft4_Items_Schema	308.01218668545425 ns/iter	289.2771952011272 ns/iter	1.06
Evaluator_Draft4_Nested_Object	3.8066362136365237 ns/iter	3.5856653157700005 ns/iter	1.06
Evaluator_Draft4_Properties_Triad_Optional	813.7678419135287 ns/iter	887.1271770499259 ns/iter	0.92
Evaluator_Draft4_Properties_Triad_Closed	644.345774407023 ns/iter	689.8945074835657 ns/iter	0.93
Evaluator_Draft4_Properties_Triad_Required	805.5970315597199 ns/iter	838.1470098025782 ns/iter	0.96
Evaluator_Draft4_Properties_Closed	47.42923651851765 ns/iter	57.92009985502487 ns/iter	0.82
Evaluator_Draft4_Non_Recursive_Ref	10.118386405447556 ns/iter	14.480728580936178 ns/iter	0.70
Evaluator_Draft4_Pattern_Properties_True	175.73257167822297 ns/iter	257.37066746477325 ns/iter	0.68
Evaluator_Draft4_Ref_To_Single_Property	7.780411938593219 ns/iter	9.94564286555836 ns/iter	0.78
Evaluator_Draft4_Additional_Properties_Type	16.947775909310973 ns/iter	24.246395076327588 ns/iter	0.70
Evaluator_Draft4_Nested_Oneof	50.239316991260786 ns/iter	70.25690403379639 ns/iter	0.72
Evaluator_Draft4_Short_Enum	9.920913221524199 ns/iter	11.781434319216762 ns/iter	0.84
Evaluator_Draft4_Long_Enum	31.40745293060518 ns/iter	39.34672904827827 ns/iter	0.80
Evaluator_Draft4_Long_Enum_Short_Strings	11.119301157445737 ns/iter	12.98711378939882 ns/iter	0.86
Evaluator_Draft4_Type_Object	6.091546362624133 ns/iter	8.564775722346914 ns/iter	0.71
Evaluator_Draft6_Property_Names	99.59413169576572 ns/iter	128.16955142376722 ns/iter	0.78
Evaluator_Draft7_If_Then_Else	27.538940817676476 ns/iter	35.81957713261134 ns/iter	0.77
Evaluator_Draft7_Vercel_1	34733.09289591074 ns/iter	52434.34999999863 ns/iter	0.66
Evaluator_Draft7_Helm_Chart_Lock_1	121.06624994901486 ns/iter	162.6237091749252 ns/iter	0.74
Evaluator_Draft7_Helm_Chart_Lock_2	115.84930094805416 ns/iter	170.2382821088753 ns/iter	0.68
Evaluator_Draft7_Jasmine_1	150.8878837870125 ns/iter	156.13269183924194 ns/iter	0.97
Evaluator_Draft7_Dependabot_1	1015.166283663589 ns/iter	1095.9373437424697 ns/iter	0.93
Evaluator_2019_09_Unevaluated_Properties	40.105965933907854 ns/iter	54.14788639595875 ns/iter	0.74
Evaluator_2019_09_OMC_JSON_V2_1	966.5196246962197 ns/iter	927.4567595832381 ns/iter	1.04
Evaluator_2020_12_Dynamic_Ref	395.95457660153005 ns/iter	433.52844007317657 ns/iter	0.91
Evaluator_2020_12_Dynamic_Ref_Single	5.557755547908467 ns/iter	5.571060346982749 ns/iter	1.00
Evaluator_2020_12_CQL_1	2122.2903554540953 ns/iter	2018.861459211767 ns/iter	1.05
Evaluator_2020_12_OpenAPI	161225.96153845676 ns/iter	159962.24583048304 ns/iter	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/gcc)

Benchmark suite	Current: 98abf41	Previous: 9407a4c	Ratio
Compiler_Draft6_AdaptiveCard	61976317167.282104 ns/iter	64734306097.03064 ns/iter	0.96
Compiler_2019_09_OMC_JSON_V2	8696252107.62024 ns/iter	8458416938.781738 ns/iter	1.03
Evaluator_Draft4_Meta_1_No_Callback	178.2903766833421 ns/iter	163.02391576822683 ns/iter	1.09
Evaluator_Draft4_Required_Properties	342.4167572928144 ns/iter	318.63273728325936 ns/iter	1.07
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	19.17302789607509 ns/iter	18.92960947895588 ns/iter	1.01
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	8.003711826129413 ns/iter	7.15609717593663 ns/iter	1.12
Evaluator_Draft4_Items_Schema	463.8012782320742 ns/iter	438.8433737795815 ns/iter	1.06
Evaluator_Draft4_Nested_Object	2.129495103700767 ns/iter	2.0497640904373142 ns/iter	1.04
Evaluator_Draft4_Properties_Triad_Optional	867.9730742284504 ns/iter	809.8357572791394 ns/iter	1.07
Evaluator_Draft4_Properties_Triad_Closed	671.0465462954368 ns/iter	672.364262295252 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Required	841.6186261935093 ns/iter	827.4057168702191 ns/iter	1.02
Evaluator_Draft4_Properties_Closed	66.86381379495329 ns/iter	66.4765707484844 ns/iter	1.01
Evaluator_Draft4_Non_Recursive_Ref	13.819172003415368 ns/iter	12.947752629591156 ns/iter	1.07
Evaluator_Draft4_Pattern_Properties_True	184.77649961554445 ns/iter	183.51331928842714 ns/iter	1.01
Evaluator_Draft4_Ref_To_Single_Property	7.044718825940532 ns/iter	7.064671192191903 ns/iter	1.00
Evaluator_Draft4_Additional_Properties_Type	23.906381455374934 ns/iter	24.480833447332966 ns/iter	0.98
Evaluator_Draft4_Nested_Oneof	55.31020790556156 ns/iter	56.990769398242044 ns/iter	0.97
Evaluator_Draft4_Short_Enum	7.866321616421756 ns/iter	7.895374911147297 ns/iter	1.00
Evaluator_Draft4_Long_Enum	8.752077376669392 ns/iter	8.818104997104042 ns/iter	0.99
Evaluator_Draft4_Long_Enum_Short_Strings	7.926121337230412 ns/iter	8.138946204289505 ns/iter	0.97
Evaluator_Draft4_Type_Object	4.594516339407728 ns/iter	4.583446219751131 ns/iter	1.00
Evaluator_Draft6_Property_Names	101.32881472015237 ns/iter	103.84601271514067 ns/iter	0.98
Evaluator_Draft7_If_Then_Else	24.609463612692814 ns/iter	25.13254129825393 ns/iter	0.98
Evaluator_Draft7_Vercel_1	39728.512167234716 ns/iter	39213.31942814771 ns/iter	1.01
Evaluator_Draft7_Helm_Chart_Lock_1	165.5083860320289 ns/iter	167.81543542248556 ns/iter	0.99
Evaluator_Draft7_Helm_Chart_Lock_2	157.17694064249568 ns/iter	161.02098730654885 ns/iter	0.98
Evaluator_Draft7_Jasmine_1	123.56592631602778 ns/iter	136.25264362367477 ns/iter	0.91
Evaluator_Draft7_Dependabot_1	857.1992360368192 ns/iter	884.2472517672962 ns/iter	0.97
Evaluator_2019_09_Unevaluated_Properties	32.946958484329144 ns/iter	33.54936685152304 ns/iter	0.98
Evaluator_2019_09_OMC_JSON_V2_1	1135.0408811114642 ns/iter	1122.9689374687832 ns/iter	1.01
Evaluator_2020_12_Dynamic_Ref	462.20324671689866 ns/iter	482.3474129489419 ns/iter	0.96
Evaluator_2020_12_Dynamic_Ref_Single	4.750681964624819 ns/iter	5.096487998962402 ns/iter	0.93
Evaluator_2020_12_CQL_1	2581.6497988803417 ns/iter	2598.6311322766715 ns/iter	0.99
Evaluator_2020_12_OpenAPI	180066.50266479186 ns/iter	180720.0092906656 ns/iter	1.00

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (windows/msvc)

Benchmark suite	Current: 98abf41	Previous: 9407a4c	Ratio
Compiler_Draft6_AdaptiveCard	169461286099.99994 ns/iter	169399379800.00003 ns/iter	1.00
Compiler_2019_09_OMC_JSON_V2	24462185500.00003 ns/iter	24567057099.999943 ns/iter	1.00
Evaluator_Draft4_Meta_1_No_Callback	382.4662946428755 ns/iter	378.5713169642665 ns/iter	1.01
Evaluator_Draft4_Required_Properties	772.0878348213794 ns/iter	775.7823660714536 ns/iter	1.00
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	38.70567788025933 ns/iter	38.44281359923521 ns/iter	1.01
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	16.522504464287888 ns/iter	16.529923326808714 ns/iter	1.00
Evaluator_Draft4_Items_Schema	684.9034598214334 ns/iter	680.7569642857304 ns/iter	1.01
Evaluator_Draft4_Nested_Object	6.836411607143386 ns/iter	6.810917857142686 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Optional	1552.2279017855362 ns/iter	1525.4301339286008 ns/iter	1.02
Evaluator_Draft4_Properties_Triad_Closed	1240.4567857142217 ns/iter	1229.2726785714437 ns/iter	1.01
Evaluator_Draft4_Properties_Triad_Required	1544.1310267857286 ns/iter	1509.122991071215 ns/iter	1.02
Evaluator_Draft4_Properties_Closed	91.87111197002375 ns/iter	91.76912946428878 ns/iter	1.00
Evaluator_Draft4_Non_Recursive_Ref	33.599208337484335 ns/iter	33.57665104600795 ns/iter	1.00
Evaluator_Draft4_Pattern_Properties_True	236.57485082872205 ns/iter	233.83139131345908 ns/iter	1.01
Evaluator_Draft4_Ref_To_Single_Property	16.749687499998547 ns/iter	16.811164842782613 ns/iter	1.00
Evaluator_Draft4_Additional_Properties_Type	62.53526000000419 ns/iter	61.05139285714196 ns/iter	1.02
Evaluator_Draft4_Nested_Oneof	112.00296874999793 ns/iter	112.13243749999435 ns/iter	1.00
Evaluator_Draft4_Short_Enum	24.493724999997216 ns/iter	24.632468914949325 ns/iter	0.99
Evaluator_Draft4_Long_Enum	23.62372071848329 ns/iter	23.709984110379896 ns/iter	1.00
Evaluator_Draft4_Long_Enum_Short_Strings	28.094674107147657 ns/iter	27.685743626402893 ns/iter	1.01
Evaluator_Draft4_Type_Object	14.311082748608726 ns/iter	14.498999935274297 ns/iter	0.99
Evaluator_Draft6_Property_Names	166.7327321472757 ns/iter	166.1284441604081 ns/iter	1.00
Evaluator_Draft7_If_Then_Else	54.34905357144462 ns/iter	54.23414285714452 ns/iter	1.00
Evaluator_Draft7_Vercel_1	77096.42857141676 ns/iter	70926.54017857621 ns/iter	1.09
Evaluator_Draft7_Helm_Chart_Lock_1	287.9900630362015 ns/iter	287.8513250166084 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_2	264.1085586655197 ns/iter	263.53921042588223 ns/iter	1.00
Evaluator_Draft7_Jasmine_1	217.47956249996037 ns/iter	217.86040625002556 ns/iter	1.00
Evaluator_Draft7_Dependabot_1	1549.6698660716188 ns/iter	1555.1006696427853 ns/iter	1.00
Evaluator_2019_09_Unevaluated_Properties	73.7859821428393 ns/iter	73.77338169642604 ns/iter	1.00
Evaluator_2019_09_OMC_JSON_V2_1	1907.3615244296602 ns/iter	1938.5607487150558 ns/iter	0.98
Evaluator_2020_12_Dynamic_Ref	865.4552832787905 ns/iter	867.1043450428695 ns/iter	1.00
Evaluator_2020_12_Dynamic_Ref_Single	14.409956185673263 ns/iter	14.29252225762294 ns/iter	1.01
Evaluator_2020_12_CQL_1	5076.866999997947 ns/iter	4962.500892856627 ns/iter	1.02
Evaluator_2020_12_OpenAPI	276296.3037364415 ns/iter	273132.6375711705 ns/iter	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Benchmark suite	Current: 98abf41	Previous: 9407a4c	Ratio
Evaluator_2020_12_Dynamic_Ref	628.3929637469972 ns/iter	629.9545227081409 ns/iter	1.00
Evaluator_2020_12_Dynamic_Ref_Single	9.723210063503382 ns/iter	9.728833266173474 ns/iter	1.00
Evaluator_2020_12_CQL_1	3796.656551083141 ns/iter	3810.401633834374 ns/iter	1.00
Evaluator_2020_12_OpenAPI	229987.8718520818 ns/iter	226287.92829583815 ns/iter	1.02
Evaluator_2019_09_Unevaluated_Properties	52.82419681315962 ns/iter	53.025391705204775 ns/iter	1.00
Evaluator_2019_09_OMC_JSON_V2_1	1339.6760748419717 ns/iter	1342.6852278667757 ns/iter	1.00
Evaluator_Draft7_If_Then_Else	45.9501442804759 ns/iter	45.67639563512087 ns/iter	1.01
Evaluator_Draft7_Vercel_1	46912.02953333686 ns/iter	47353.492186963704 ns/iter	0.99
Evaluator_Draft7_Helm_Chart_Lock_1	124.85024586420853 ns/iter	124.58051549715542 ns/iter	1.00
Evaluator_Draft7_Helm_Chart_Lock_2	119.93768972409819 ns/iter	119.9646312602388 ns/iter	1.00
Evaluator_Draft7_Jasmine_1	150.2833308910238 ns/iter	150.4549489415123 ns/iter	1.00
Evaluator_Draft7_Dependabot_1	920.9696912351355 ns/iter	931.5927398259514 ns/iter	0.99
Evaluator_Draft6_Property_Names	162.29791945635665 ns/iter	162.1077122589247 ns/iter	1.00
Evaluator_Draft4_Meta_1_No_Callback	243.9069218677893 ns/iter	246.3680961650801 ns/iter	0.99
Evaluator_Draft4_Required_Properties	476.2774050797117 ns/iter	472.4561321898094 ns/iter	1.01
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match	29.2518550306281 ns/iter	29.054597935973078 ns/iter	1.01
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match	10.664656822046053 ns/iter	10.669092509756856 ns/iter	1.00
Evaluator_Draft4_Items_Schema	511.2350878476391 ns/iter	494.58746083547675 ns/iter	1.03
Evaluator_Draft4_Nested_Object	3.8148651499719053 ns/iter	3.8115568859776663 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Optional	1044.88632725806 ns/iter	1041.7090840337992 ns/iter	1.00
Evaluator_Draft4_Properties_Triad_Closed	843.7070083795927 ns/iter	836.8324848504797 ns/iter	1.01
Evaluator_Draft4_Properties_Triad_Required	1051.8197703406368 ns/iter	1053.7121444067689 ns/iter	1.00
Evaluator_Draft4_Properties_Closed	72.89515758505283 ns/iter	73.04833086763475 ns/iter	1.00
Evaluator_Draft4_Non_Recursive_Ref	12.563946324394502 ns/iter	12.577737210467191 ns/iter	1.00
Evaluator_Draft4_Pattern_Properties_True	259.046175012814 ns/iter	261.45613411914064 ns/iter	0.99
Evaluator_Draft4_Ref_To_Single_Property	10.698664547390877 ns/iter	10.709632581493166 ns/iter	1.00
Evaluator_Draft4_Additional_Properties_Type	15.004786215165245 ns/iter	15.012625168389095 ns/iter	1.00
Evaluator_Draft4_Nested_Oneof	109.94056389474635 ns/iter	110.82875774406023 ns/iter	0.99
Evaluator_Draft4_Short_Enum	18.04235649607151 ns/iter	18.059784605231158 ns/iter	1.00
Evaluator_Draft4_Long_Enum	19.103742819436555 ns/iter	18.438735582799332 ns/iter	1.04
Evaluator_Draft4_Long_Enum_Short_Strings	18.263876088959314 ns/iter	18.047299575306287 ns/iter	1.01
Evaluator_Draft4_Type_Object	9.768195103425231 ns/iter	9.763988042068897 ns/iter	1.00
Compiler_2019_09_OMC_JSON_V2	11092746444 ns/iter	10943692188.999989 ns/iter	1.01
Compiler_Draft6_AdaptiveCard	71880511023.00006 ns/iter	70439651394.00006 ns/iter	1.02

This comment was automatically generated by workflow using github-action-benchmark.