Fix SimpleOutput leaking annotations of failed branches

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: e5c5c9a	Previous: 9d13de4	Ratio
Schema_Iterator_ISO_Language	2075250.8664692533 ns/iter	2732745.7218541666 ns/iter	0.76
Schema_Tracker_ISO_Language	3557235.2100007264 ns/iter	4678140.361701035 ns/iter	0.76
Schema_Tracker_ISO_Language_To_JSON	19176739.285714053 ns/iter	27090303.41025727 ns/iter	0.71
Schema_Frame_WoT_References	6737431.280700086 ns/iter	9925914.803570127 ns/iter	0.68
Schema_Frame_OMC_References	30624264.521748044 ns/iter	38139102.27272159 ns/iter	0.80
Schema_Frame_OMC_Locations	22886950.53125167 ns/iter	31521751.615383226 ns/iter	0.73
Schema_Frame_ISO_Language_Locations	77257767.85712565 ns/iter	97130847.2222366 ns/iter	0.80
Schema_Frame_KrakenD_References	40851914.38888261 ns/iter	62037128.818184845 ns/iter	0.66
Schema_Frame_KrakenD_Reachable	378476728.99999905 ns/iter	557561459.000226 ns/iter	0.68
Schema_Frame_ISO_Language_Locations_To_JSON	81372963.50000156 ns/iter	107584398.85713804 ns/iter	0.76
Schema_Frame_Many_Resources_References	311713062.4999618 ns/iter	341107854.00002897 ns/iter	0.91
Schema_Bundle_Meta_2020_12	1322118.704049929 ns/iter	2102214.9642066015 ns/iter	0.63
Schema_Format_ISO_Language_To_JSON	82933286.50003673 ns/iter	102334008.19997768 ns/iter	0.81
E2E_Compiler_adaptivecard	60178690.91666246 ns/iter	79028574.11110947 ns/iter	0.76
E2E_Compiler_ansible_meta	23692711.68000523 ns/iter	41107621.54166991 ns/iter	0.58
E2E_Compiler_aws_cdk	384383.21250563563 ns/iter	466034.1259652243 ns/iter	0.82
E2E_Compiler_babelrc	2434113.839286413 ns/iter	3227704.8777294066 ns/iter	0.75
E2E_Compiler_clang_format	18180807.547618575 ns/iter	20654223.361109164 ns/iter	0.88
E2E_Compiler_cmake_presets	26606698.275858875 ns/iter	30974566.272727147 ns/iter	0.86
E2E_Compiler_code_climate	2870505.082677568 ns/iter	2662991.9884612714 ns/iter	1.08
E2E_Compiler_cql2	11889069.962260796 ns/iter	15647329.39622668 ns/iter	0.76
E2E_Compiler_cspell	20149086.9142877 ns/iter	29907376.35483246 ns/iter	0.67
E2E_Compiler_cypress	3436712.7766495636 ns/iter	5951755.000000957 ns/iter	0.58
E2E_Compiler_deno	7408148.062501547 ns/iter	11271391.886077277 ns/iter	0.66
E2E_Compiler_dependabot	4636194.817567844 ns/iter	5484579.241070264 ns/iter	0.85
E2E_Compiler_draft_04	2769986.162455111 ns/iter	2803053.5458939364 ns/iter	0.99
E2E_Compiler_fabric_mod	5356999.99999945 ns/iter	5332149.253731519 ns/iter	1.00
E2E_Compiler_geojson	30285930.57142427 ns/iter	30177047.607139684 ns/iter	1.00
E2E_Compiler_gitpod_configuration	5316187.318582537 ns/iter	5922022.165137655 ns/iter	0.90
E2E_Compiler_helm_chart_lock	663567.1296296148 ns/iter	776905.3497941901 ns/iter	0.85
E2E_Compiler_importmap	277643.7590410229 ns/iter	385150.2234416095 ns/iter	0.72
E2E_Compiler_jasmine	1334486.842105626 ns/iter	1433111.084905781 ns/iter	0.93
E2E_Compiler_jshintrc	4820246.956204337 ns/iter	4107946.4285713853 ns/iter	1.17
E2E_Compiler_jsconfig	27440664.999994624 ns/iter	27353171.461536128 ns/iter	1.00
E2E_Compiler_krakend	152493458.40002206 ns/iter	188151427.24997714 ns/iter	0.81
E2E_Compiler_lazygit	34527990.77777197 ns/iter	41742578.411766075 ns/iter	0.83
E2E_Compiler_lerna	1422401.2756757645 ns/iter	1857125.7606486666 ns/iter	0.77
E2E_Compiler_nest_cli	7293164.905264635 ns/iter	8765905.927834256 ns/iter	0.83
E2E_Compiler_omc	185258722.33332548 ns/iter	215534263.66669253 ns/iter	0.86
E2E_Compiler_omnisharp	6567717.557522601 ns/iter	8346886.960396768 ns/iter	0.79
E2E_Compiler_openapi	25622225.29629118 ns/iter	31571784.7500044 ns/iter	0.81
E2E_Compiler_pre_commit_hooks	4239520.82911323 ns/iter	5947809.170002074 ns/iter	0.71
E2E_Compiler_pulumi	3064211.0042737112 ns/iter	4180568.0600009514 ns/iter	0.73
E2E_Compiler_semantic_release	1141880.4324323616 ns/iter	1585619.859813229 ns/iter	0.72
E2E_Compiler_stale	1163589.996768812 ns/iter	1835728.268994079 ns/iter	0.63
E2E_Compiler_stylecop	5666230.233577564 ns/iter	7632016.203703845 ns/iter	0.74
E2E_Compiler_tmuxinator	1987689.8367345217 ns/iter	1973658.9349396313 ns/iter	1.01
E2E_Compiler_ui5	66873924.27273732 ns/iter	63527472.16667846 ns/iter	1.05
E2E_Compiler_ui5_manifest	380726541.4999392 ns/iter	453820271.00004053 ns/iter	0.84
E2E_Compiler_unreal_engine_uproject	3761109.5202692016 ns/iter	5175036.921053489 ns/iter	0.73
E2E_Compiler_users_array	786257.9520000769 ns/iter	880336.6242037631 ns/iter	0.89
E2E_Compiler_vercel	11335018.600000415 ns/iter	18879524.23255736 ns/iter	0.60
E2E_Compiler_yamllint	253351.82383802673 ns/iter	368143.8138587295 ns/iter	0.69
E2E_Evaluator_adaptivecard	18537.97123411615 ns/iter	25556.883963198277 ns/iter	0.73
E2E_Evaluator_ansible_meta	172993.90481958372 ns/iter	244223.54957205738 ns/iter	0.71
E2E_Evaluator_aws_cdk	37881.98332871905 ns/iter	53996.183583173515 ns/iter	0.70
E2E_Evaluator_babelrc	83138.58265980669 ns/iter	124176.00604351096 ns/iter	0.67
E2E_Evaluator_cerebrum_criminal_case	711836.8577115083 ns/iter	1100634.1613473531 ns/iter	0.65
E2E_Evaluator_clang_format	96091.02276135214 ns/iter	161798.2785151126 ns/iter	0.59
E2E_Evaluator_cmake_presets	3420287.0145620485 ns/iter	6562779.51666766 ns/iter	0.52
E2E_Evaluator_code_climate	130526.89477598362 ns/iter	246105.8673469279 ns/iter	0.53
E2E_Evaluator_cql2	142233.22495351618 ns/iter	262989.1023571139 ns/iter	0.54
E2E_Evaluator_cspell	522036.7601245827 ns/iter	654646.6174974146 ns/iter	0.80
E2E_Evaluator_cypress	184039.5891411922 ns/iter	212638.43933437552 ns/iter	0.87
E2E_Evaluator_deno	244539.07708329818 ns/iter	334580.48611110926 ns/iter	0.73
E2E_Evaluator_dependabot	238739.32813659433 ns/iter	319865.77966095327 ns/iter	0.75
E2E_Evaluator_draft_04	5300384.082706534 ns/iter	7473097.382022858 ns/iter	0.71
E2E_Evaluator_fabric_mod	489152.51196185156 ns/iter	631116.8619854458 ns/iter	0.78
E2E_Evaluator_geojson	9066065.54878092 ns/iter	11491737.499996664 ns/iter	0.79
E2E_Evaluator_gitpod_configuration	176883.61910643338 ns/iter	261719.5679919756 ns/iter	0.68
E2E_Evaluator_helm_chart_lock	236002.06550993794 ns/iter	323440.34224094794 ns/iter	0.73
E2E_Evaluator_importmap	41615.07864645374 ns/iter	45720.321082564275 ns/iter	0.91
E2E_Evaluator_jasmine	97521.73582067291 ns/iter	124320.32622334581 ns/iter	0.78
E2E_Evaluator_jshintrc	1215779.6241133013 ns/iter	1272100.7476778876 ns/iter	0.96
E2E_Evaluator_jsconfig	348346.9814813976 ns/iter	421464.03179369436 ns/iter	0.83
E2E_Evaluator_krakend	176114.52336916167 ns/iter	203104.07593907492 ns/iter	0.87
E2E_Evaluator_lazygit	112405.89787156416 ns/iter	157654.4350625954 ns/iter	0.71
E2E_Evaluator_lerna	137993.89475813243 ns/iter	168838.54422978396 ns/iter	0.82
E2E_Evaluator_nest_cli	139107.74682308233 ns/iter	188683.9635897512 ns/iter	0.74
E2E_Evaluator_omc	13593.269470572941 ns/iter	19133.187586352487 ns/iter	0.71
E2E_Evaluator_omnisharp	541898.0150580733 ns/iter	726990.0830001462 ns/iter	0.75
E2E_Evaluator_openapi	5681661.5853651045 ns/iter	8927435.8627438 ns/iter	0.64
E2E_Evaluator_pre_commit_hooks	443867.62782175903 ns/iter	519675.2080000806 ns/iter	0.85
E2E_Evaluator_pulumi	685691.4603959284 ns/iter	847253.5285016492 ns/iter	0.81
E2E_Evaluator_semantic_release	74246.36826096509 ns/iter	116068.68992863754 ns/iter	0.64
E2E_Evaluator_stale	121941.96039085828 ns/iter	190283.0188679428 ns/iter	0.64
E2E_Evaluator_stylecop	204438.97294150715 ns/iter	361689.48851452995 ns/iter	0.57
E2E_Evaluator_tmuxinator	71298.9384447055 ns/iter	96938.90902911927 ns/iter	0.74
E2E_Evaluator_ui5	362957.73429180786 ns/iter	524173.37500014587 ns/iter	0.69
E2E_Evaluator_ui5_manifest	1761560.8549617913 ns/iter	3045619.828467551 ns/iter	0.58
E2E_Evaluator_unreal_engine_uproject	348639.9929542322 ns/iter	506096.17954376823 ns/iter	0.69
E2E_Evaluator_users_array	440071.97964546765 ns/iter	667218.2717890036 ns/iter	0.66
E2E_Evaluator_vercel	279973.789059805 ns/iter	369043.4673366847 ns/iter	0.76
E2E_Evaluator_yamllint	7077.498978009398 ns/iter	10614.796520225034 ns/iter	0.67
JSONLD_Catalog	23309487.36363842 ns/iter	30305443.00000465 ns/iter	0.77
Micro_Draft4_Meta_1_No_Callback	141.62187821768669 ns/iter	195.03741100908445 ns/iter	0.73
Micro_Draft4_Required_Properties	689.8664924987072 ns/iter	966.4543158198894 ns/iter	0.71
Micro_Draft4_Many_Optional_Properties_Minimal_Match	16.64329121444575 ns/iter	22.546289644108843 ns/iter	0.74
Micro_Draft4_Few_Optional_Properties_Minimal_Match	8.194105123719082 ns/iter	11.697708950893936 ns/iter	0.70
Micro_Draft4_Items_Schema	221.59611034335768 ns/iter	343.52407254399276 ns/iter	0.65
Micro_Draft4_Nested_Object	1.042237335526943 ns/iter	1.624356015517853 ns/iter	0.64
Micro_Draft4_Properties_Triad_Optional	236.68699512005193 ns/iter	345.30601738871576 ns/iter	0.69
Micro_Draft4_Properties_Triad_Closed	200.21555279840484 ns/iter	269.6041131072978 ns/iter	0.74
Micro_Draft4_Properties_Triad_Required	268.4640849804798 ns/iter	353.78173818238633 ns/iter	0.76
Micro_Draft4_Properties_Closed	58.981924681109 ns/iter	56.99502080001366 ns/iter	1.03
Micro_Draft4_Non_Recursive_Ref	17.969500002196735 ns/iter	17.73413563648802 ns/iter	1.01
Micro_Draft4_Pattern_Properties_True	169.68462452063366 ns/iter	213.7016939179013 ns/iter	0.79
Micro_Draft4_Ref_To_Single_Property	9.206145328067317 ns/iter	11.879850734606888 ns/iter	0.77
Micro_Draft4_Additional_Properties_Type	30.528230630368245 ns/iter	35.756931656770234 ns/iter	0.85
Micro_Draft4_Nested_Oneof	35.801786471333465 ns/iter	51.82594164591902 ns/iter	0.69
Micro_Draft4_Short_Enum	4.911373949179634 ns/iter	6.174055521144293 ns/iter	0.80
Micro_Draft4_Long_Enum	9.635692723833488 ns/iter	12.690336158645886 ns/iter	0.76
Micro_Draft4_Long_Enum_Short_Strings	7.106880408761833 ns/iter	9.392452389887612 ns/iter	0.76
Micro_Draft4_Type_Object	2.49408338768277 ns/iter	2.8770714804472814 ns/iter	0.87
Micro_Draft4_Ref_Single_100	1924376.824999996 ns/iter	2375213.377223559 ns/iter	0.81
Micro_Draft4_Compile_Ref_Many_Nested	1242382.792592404 ns/iter	1828466.2410253123 ns/iter	0.68
Micro_Draft4_Compile_Wrap	2421107.087227632 ns/iter	2211132.0564517295 ns/iter	1.09
Micro_Draft6_Property_Names	110.44542897847819 ns/iter	105.12638359601877 ns/iter	1.05
Micro_Draft6_Compile_FHIR	14735542000.000124 ns/iter	18807732499.999928 ns/iter	0.78
Micro_Draft7_If_Then_Else	18.743005873667254 ns/iter	21.232105566158406 ns/iter	0.88
Micro_2019_09_Unevaluated_Properties	28.53717415740934 ns/iter	37.561859014887844 ns/iter	0.76
Micro_2019_09_Compile_Wrap	324339770.49993247 ns/iter	384033291.5000317 ns/iter	0.84
Micro_2020_12_Dynamic_Ref	662.0605538546689 ns/iter	934.2449483624633 ns/iter	0.71
Micro_2020_12_Dynamic_Ref_Single	3.014891536997086 ns/iter	3.1966445228825933 ns/iter	0.94
Micro_2020_12_Simple_Output_Mask	833.210145520917 ns/iter	1068.1037342132686 ns/iter	0.78
Micro_2020_12_Simple_Output_Annotations	60349.81557445946 ns/iter	128145.76684087943 ns/iter	0.47
Micro_2020_12_Simple_Output_Annotation_Dropping	1538044.8093125885 ns/iter	19087245.139533397 ns/iter	0.08057971687737162
Micro_2020_12_Compile_NonCircular_Shared_Refs	907038.2783505074 ns/iter	1263550.453674039 ns/iter	0.72
Micro_2020_12_Exhaustive_Deep_Numeric	6532.930384973006 ns/iter	7489.571320953281 ns/iter	0.87
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	52515.72861144029 ns/iter	80433.89780155256 ns/iter	0.65
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	15760.38699405982 ns/iter	21905.803742188262 ns/iter	0.72
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	100.24984538656298 ns/iter	142.63688628411984 ns/iter	0.70
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	3586.7285400035335 ns/iter	6147.211013915474 ns/iter	0.58
Alterschema_Check_Readibility_ISO_Language_Set_3	234549583.33331886 ns/iter	353537604.00005287 ns/iter	0.66
Alterschema_Check_Readibility_OMC	70594212.88888896 ns/iter	102759458.42857124 ns/iter	0.69
Alterschema_Check_Readibility_KrakenD	721758249.9999934 ns/iter	1180384416.9999137 ns/iter	0.61
Alterschema_Apply_Readibility_KrakenD	89827227498.99973 ns/iter	105507194000.00003 ns/iter	0.85
Alterschema_Check_Invalid_External_Refs	189621062.50000942 ns/iter	160480812.49999768 ns/iter	1.18

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: e5c5c9a	Previous: 9d13de4	Ratio
E2E_Evaluator_adaptivecard	127732 ns	115747 ns	1.10
E2E_Evaluator_ansible-meta	454797 ns	392668 ns	1.16
E2E_Evaluator_aws-cdk	146117 ns	130654 ns	1.12
E2E_Evaluator_babelrc	359654 ns	365257 ns	0.98
E2E_Evaluator_cerebrum-criminal-case	2266286 ns	1774993 ns	1.28
E2E_Evaluator_clang-format	270034 ns	203650 ns	1.33
E2E_Evaluator_cmake-presets	20850016 ns	15329524 ns	1.36
E2E_Evaluator_code-climate	610516 ns	380682 ns	1.60
E2E_Evaluator_cql2	1349303 ns	1101011 ns	1.23
E2E_Evaluator_cspell	1726681 ns	1587680 ns	1.09
E2E_Evaluator_cypress	781906 ns	815338 ns	0.96
E2E_Evaluator_deno	1228088 ns	1046032 ns	1.17
E2E_Evaluator_dependabot	1327011 ns	790255 ns	1.68
E2E_Evaluator_draft-04	22818570 ns	17158155 ns	1.33
E2E_Evaluator_fabric-mod	2463222 ns	1656317 ns	1.49
E2E_Evaluator_geojson	23823679 ns	16420238 ns	1.45
E2E_Evaluator_gitpod-configuration	607640 ns	516379 ns	1.18
E2E_Evaluator_helm-chart-lock	1105340 ns	1004640 ns	1.10
E2E_Evaluator_importmap	266560 ns	239709 ns	1.11
E2E_Evaluator_jasmine	301461 ns	225668 ns	1.34
E2E_Evaluator_jsconfig	1196343 ns	1112983 ns	1.07
E2E_Evaluator_jshintrc	2952383 ns	2523532 ns	1.17
E2E_Evaluator_krakend	822496 ns	469370 ns	1.75
E2E_Evaluator_lazygit	543996 ns	385899 ns	1.41
E2E_Evaluator_lerna	470852 ns	405861 ns	1.16
E2E_Evaluator_nest-cli	480561 ns	546474 ns	0.88
E2E_Evaluator_omc	91151 ns	81701 ns	1.12
E2E_Evaluator_omnisharp	1314183 ns	1063662 ns	1.24
E2E_Evaluator_openapi	21103380 ns	16250556 ns	1.30
E2E_Evaluator_pre-commit-hooks	2046896 ns	1434858 ns	1.43
E2E_Evaluator_pulumi	2479873 ns	1648240 ns	1.50
E2E_Evaluator_semantic-release	207755 ns	196125 ns	1.06
E2E_Evaluator_stale	359848 ns	322800 ns	1.11
E2E_Evaluator_stylecop	1333466 ns	997229 ns	1.34
E2E_Evaluator_tmuxinator	217404 ns	186889 ns	1.16
E2E_Evaluator_ui5	2125288 ns	2179719 ns	0.98
E2E_Evaluator_ui5-manifest	13640398 ns	12472184 ns	1.09
E2E_Evaluator_unreal-engine-uproject	1757864 ns	1626801 ns	1.08
E2E_Evaluator_users-array	3472731 ns	3073967 ns	1.13
E2E_Evaluator_vercel	880478 ns	919360 ns	0.96
E2E_Evaluator_yamllint	26244 ns	29935 ns	0.88

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: e5c5c9a	Previous: 9d13de4	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	339541941.49998784 ns/iter	208829110.99996212 ns/iter	1.63
Alterschema_Check_Readibility_OMC	102211936.99999276 ns/iter	73788293.77777644 ns/iter	1.39
Alterschema_Check_Readibility_KrakenD	1421976110.9998217 ns/iter	1351391634.000038 ns/iter	1.05
Alterschema_Apply_Readibility_KrakenD	133393810375.99992 ns/iter	126558849305.99995 ns/iter	1.05
Alterschema_Check_Invalid_External_Refs	288920268.50007826 ns/iter	146073245.39997536 ns/iter	1.98
Micro_2020_12_Dynamic_Ref	806.1226352472576 ns/iter	457.8686047759076 ns/iter	1.76
Micro_2020_12_Dynamic_Ref_Single	4.582022887754827 ns/iter	3.057000052319465 ns/iter	1.50
Micro_2020_12_Simple_Output_Mask	1088.570204380083 ns/iter	682.4427433798663 ns/iter	1.60
Micro_2020_12_Simple_Output_Annotations	71579.09613407824 ns/iter	72007.77875826607 ns/iter	0.99
Micro_2020_12_Simple_Output_Annotation_Dropping	1902967.0136984498 ns/iter	6423418.287037445 ns/iter	0.30
Micro_2020_12_Compile_NonCircular_Shared_Refs	1091825.5031055426 ns/iter	727853.2331605242 ns/iter	1.50
Micro_2020_12_Exhaustive_Deep_Numeric	8902.163978425928 ns/iter	5494.310803571724 ns/iter	1.62
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	53835.32290012202 ns/iter	53857.78699893472 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	26518.28526479896 ns/iter	15451.948879816311 ns/iter	1.72
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	159.2183507344982 ns/iter	95.8009397538133 ns/iter	1.66
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	3135.9279517309087 ns/iter	2863.117046619294 ns/iter	1.10
Micro_2019_09_Unevaluated_Properties	31.046106362575447 ns/iter	19.549033230734338 ns/iter	1.59
Micro_2019_09_Compile_Wrap	298629734.50008214 ns/iter	203860709.33333635 ns/iter	1.46
Micro_Draft7_If_Then_Else	25.402843176153784 ns/iter	16.934777479475603 ns/iter	1.50
Micro_Draft6_Property_Names	142.89503475912855 ns/iter	95.00031999368016 ns/iter	1.50
Micro_Draft6_Compile_FHIR	14440251026.00017 ns/iter	15775821260.000156 ns/iter	0.92
Micro_Draft4_Meta_1_No_Callback	181.4628558419518 ns/iter	118.01327826411949 ns/iter	1.54
Micro_Draft4_Required_Properties	896.5369244792232 ns/iter	646.1346211455319 ns/iter	1.39
Micro_Draft4_Many_Optional_Properties_Minimal_Match	22.422605665241047 ns/iter	14.677462426243133 ns/iter	1.53
Micro_Draft4_Few_Optional_Properties_Minimal_Match	15.847457492396709 ns/iter	10.028459188463145 ns/iter	1.58
Micro_Draft4_Items_Schema	293.23644197437136 ns/iter	230.29475270897322 ns/iter	1.27
Micro_Draft4_Nested_Object	1.768441432005328 ns/iter	0.9609698115447338 ns/iter	1.84
Micro_Draft4_Properties_Triad_Optional	455.9937013400726 ns/iter	197.8923287583821 ns/iter	2.30
Micro_Draft4_Properties_Triad_Closed	375.0874782444673 ns/iter	164.5580057535604 ns/iter	2.28
Micro_Draft4_Properties_Triad_Required	495.56710245715846 ns/iter	221.72745461370098 ns/iter	2.24
Micro_Draft4_Properties_Closed	65.01154441373735 ns/iter	42.705340885378895 ns/iter	1.52
Micro_Draft4_Non_Recursive_Ref	8.803658401504535 ns/iter	6.214787942637111 ns/iter	1.42
Micro_Draft4_Pattern_Properties_True	198.2171408356422 ns/iter	127.95921407047202 ns/iter	1.55
Micro_Draft4_Ref_To_Single_Property	16.269162102886405 ns/iter	10.004326058625841 ns/iter	1.63
Micro_Draft4_Additional_Properties_Type	13.926764289447986 ns/iter	9.674924853888957 ns/iter	1.44
Micro_Draft4_Nested_Oneof	64.9636300070653 ns/iter	47.15282916393402 ns/iter	1.38
Micro_Draft4_Short_Enum	14.541576401847221 ns/iter	8.40745685657369 ns/iter	1.73
Micro_Draft4_Long_Enum	13.387666827988989 ns/iter	8.329568206835551 ns/iter	1.61
Micro_Draft4_Long_Enum_Short_Strings	14.501397185407916 ns/iter	8.782256655985572 ns/iter	1.65
Micro_Draft4_Type_Object	4.576487230174916 ns/iter	3.18688720909873 ns/iter	1.44
Micro_Draft4_Ref_Single_100	2480803.0105626923 ns/iter	1650762.0259433696 ns/iter	1.50
Micro_Draft4_Compile_Ref_Many_Nested	1835484.2283461133 ns/iter	1212245.935251552 ns/iter	1.51
Micro_Draft4_Compile_Wrap	2613094.6928835725 ns/iter	1701960.046116079 ns/iter	1.54
JSONLD_Catalog	24592673.2500022 ns/iter	14627293.18749704 ns/iter	1.68
E2E_Compiler_adaptivecard	59864063.91667742 ns/iter	41318316.999997795 ns/iter	1.45
E2E_Compiler_ansible_meta	28228337.319997083 ns/iter	18799792.567567755 ns/iter	1.50
E2E_Compiler_aws_cdk	353396.86400401377 ns/iter	236286.15615511278 ns/iter	1.50
E2E_Compiler_babelrc	2539566.218181955 ns/iter	1656773.3696680916 ns/iter	1.53
E2E_Compiler_clang_format	17680235.40000172 ns/iter	11507809.655738322 ns/iter	1.54
E2E_Compiler_cmake_presets	27198669.61538523 ns/iter	18230497.473681632 ns/iter	1.49
E2E_Compiler_code_climate	2621981.4742640154 ns/iter	1697292.2257285337 ns/iter	1.54
E2E_Compiler_cql2	14121550.01999963 ns/iter	9791014.830984175 ns/iter	1.44
E2E_Compiler_cspell	24102224.310346518 ns/iter	16160548.651161535 ns/iter	1.49
E2E_Compiler_cypress	4200019.700598302 ns/iter	2864466.4448982403 ns/iter	1.47
E2E_Compiler_deno	7912639.932584078 ns/iter	5258551.375939881 ns/iter	1.50
E2E_Compiler_dependabot	3865344.065933551 ns/iter	2648021.095056917 ns/iter	1.46
E2E_Compiler_draft_04	2720906.93410903 ns/iter	1806916.8943296382 ns/iter	1.51
E2E_Compiler_fabric_mod	4660397.346666893 ns/iter	3098193.553097367 ns/iter	1.50
E2E_Compiler_geojson	22521978.38709347 ns/iter	14762116.23404158 ns/iter	1.53
E2E_Compiler_gitpod_configuration	4973568.276595193 ns/iter	3492797.2149534132 ns/iter	1.42
E2E_Compiler_helm_chart_lock	634996.2677596789 ns/iter	439956.0387302035 ns/iter	1.44
E2E_Compiler_importmap	257737.2871323124 ns/iter	182762.55052912334 ns/iter	1.41
E2E_Compiler_jasmine	1324045.0853890383 ns/iter	946409.2382863984 ns/iter	1.40
E2E_Compiler_jshintrc	4117714.664706749 ns/iter	2621060.074906201 ns/iter	1.57
E2E_Compiler_jsconfig	21360270.90909231 ns/iter	14201080.2244896 ns/iter	1.50
E2E_Compiler_krakend	136368273.00001642 ns/iter	90933220.71427272 ns/iter	1.50
E2E_Compiler_lazygit	32995961.238103043 ns/iter	22788776.874996588 ns/iter	1.45
E2E_Compiler_lerna	1572738.3198197032 ns/iter	1183965.4513679615 ns/iter	1.33
E2E_Compiler_nest_cli	7316079.4148948975 ns/iter	5378527.055117455 ns/iter	1.36
E2E_Compiler_omc	160445469.25002122 ns/iter	105866656.33331905 ns/iter	1.52
E2E_Compiler_omnisharp	6496080.138889384 ns/iter	4192205.437125458 ns/iter	1.55
E2E_Compiler_openapi	25458215.59259046 ns/iter	16993194.487806648 ns/iter	1.50
E2E_Compiler_pre_commit_hooks	5138564.132352031 ns/iter	3483806.8700003074 ns/iter	1.47
E2E_Compiler_pulumi	3981711.5113643035 ns/iter	2650372.772726748 ns/iter	1.50
E2E_Compiler_semantic_release	1519833.2891303757 ns/iter	1037230.6073527264 ns/iter	1.47
E2E_Compiler_stale	1516817.2668113573 ns/iter	1039307.9249999865 ns/iter	1.46
E2E_Compiler_stylecop	5720909.30578375 ns/iter	3654255.7120415447 ns/iter	1.57
E2E_Compiler_tmuxinator	1868994.4133335908 ns/iter	1228090.91754358 ns/iter	1.52
E2E_Compiler_ui5	49744584.4999902 ns/iter	34586047.28571334 ns/iter	1.44
E2E_Compiler_ui5_manifest	306090832.99998474 ns/iter	206057976.33334076 ns/iter	1.49
E2E_Compiler_unreal_engine_uproject	4490585.987178829 ns/iter	2962819.864406402 ns/iter	1.52
E2E_Compiler_users_array	874401.8506900462 ns/iter	619895.4697479052 ns/iter	1.41
E2E_Compiler_vercel	13060500.629628088 ns/iter	8854802.357141774 ns/iter	1.47
E2E_Compiler_yamllint	326306.23062646843 ns/iter	219488.16127008884 ns/iter	1.49
E2E_Evaluator_adaptivecard	25470.227974965033 ns/iter	15451.988258401445 ns/iter	1.65
E2E_Evaluator_ansible_meta	263894.64175156516 ns/iter	176162.09047619556 ns/iter	1.50
E2E_Evaluator_aws_cdk	56542.51544637355 ns/iter	37431.30738947722 ns/iter	1.51
E2E_Evaluator_babelrc	98930.10232362512 ns/iter	69966.50466914903 ns/iter	1.41
E2E_Evaluator_cerebrum_criminal_case	1170350.7491584735 ns/iter	824651.0819671784 ns/iter	1.42
E2E_Evaluator_clang_format	99648.83380600195 ns/iter	71593.21404442405 ns/iter	1.39
E2E_Evaluator_cmake_presets	4834876.0275859665 ns/iter	3677914.8947373056 ns/iter	1.31
E2E_Evaluator_code_climate	201288.52981844996 ns/iter	163298.1307997551 ns/iter	1.23
E2E_Evaluator_cql2	210282.99970146065 ns/iter	150065.04239706323 ns/iter	1.40
E2E_Evaluator_cspell	570945.1768091648 ns/iter	495289.80541327834 ns/iter	1.15
E2E_Evaluator_cypress	159842.98195112054 ns/iter	136344.92056984745 ns/iter	1.17
E2E_Evaluator_deno	301205.08018024196 ns/iter	273350.60695783846 ns/iter	1.10
E2E_Evaluator_dependabot	360231.7507756411 ns/iter	270833.71185128763 ns/iter	1.33
E2E_Evaluator_draft_04	7150369.744681968 ns/iter	4604290.7744359905 ns/iter	1.55
E2E_Evaluator_fabric_mod	768495.9310344422 ns/iter	574832.6855545174 ns/iter	1.34
E2E_Evaluator_geojson	20416558.11111317 ns/iter	13325832.79545154 ns/iter	1.53
E2E_Evaluator_gitpod_configuration	243406.10349653062 ns/iter	162614.73010300985 ns/iter	1.50
E2E_Evaluator_helm_chart_lock	218612.7349701166 ns/iter	317297.26098537067 ns/iter	0.69
E2E_Evaluator_importmap	41154.141061379385 ns/iter	20747.851710572162 ns/iter	1.98
E2E_Evaluator_jasmine	113066.85453958699 ns/iter	80347.4990262302 ns/iter	1.41
E2E_Evaluator_jshintrc	1055585.351963974 ns/iter	895937.5189254313 ns/iter	1.18
E2E_Evaluator_jsconfig	433035.7547054873 ns/iter	276579.74536860496 ns/iter	1.57
E2E_Evaluator_krakend	194626.10565517086 ns/iter	119682.00536799699 ns/iter	1.63
E2E_Evaluator_lazygit	132270.60451015676 ns/iter	87709.6381225395 ns/iter	1.51
E2E_Evaluator_lerna	138829.8344265404 ns/iter	126424.04760175942 ns/iter	1.10
E2E_Evaluator_nest_cli	195413.07692311006 ns/iter	131390.57097198727 ns/iter	1.49
E2E_Evaluator_omc	18632.639901898325 ns/iter	11097.944313038673 ns/iter	1.68
E2E_Evaluator_omnisharp	532683.00540546 ns/iter	438090.37604105007 ns/iter	1.22
E2E_Evaluator_openapi	10275601.515149212 ns/iter	5925580.965217507 ns/iter	1.73
E2E_Evaluator_pre_commit_hooks	485497.1355810904 ns/iter	392381.9893197642 ns/iter	1.24
E2E_Evaluator_pulumi	783511.0708661934 ns/iter	601255.006902387 ns/iter	1.30
E2E_Evaluator_semantic_release	93640.87659459955 ns/iter	62291.404704199296 ns/iter	1.50
E2E_Evaluator_stale	176324.96529171948 ns/iter	107564.99276255445 ns/iter	1.64
E2E_Evaluator_stylecop	310281.6761947833 ns/iter	193794.77110160014 ns/iter	1.60
E2E_Evaluator_tmuxinator	97844.76595743411 ns/iter	67738.18085001704 ns/iter	1.44
E2E_Evaluator_ui5	555756.7508038797 ns/iter	366042.8512874757 ns/iter	1.52
E2E_Evaluator_ui5_manifest	2856885.16803326 ns/iter	2227874.1279765633 ns/iter	1.28
E2E_Evaluator_unreal_engine_uproject	465377.6430007713 ns/iter	333654.52324425115 ns/iter	1.39
E2E_Evaluator_users_array	679966.4553397537 ns/iter	555100.3013810684 ns/iter	1.22
E2E_Evaluator_vercel	281649.0663680831 ns/iter	254922.52571431044 ns/iter	1.10
E2E_Evaluator_yamllint	11937.08657707994 ns/iter	8426.590167593311 ns/iter	1.42
Schema_Format_ISO_Language_To_JSON	109968213.66669942 ns/iter	67336594.22224669 ns/iter	1.63
Schema_Bundle_Meta_2020_12	1735180.8670067382 ns/iter	1178107.8117702473 ns/iter	1.47
Schema_Frame_WoT_References	5231139.187970229 ns/iter	3422905.697560764 ns/iter	1.53
Schema_Frame_OMC_References	22371079.774192397 ns/iter	14687029.860460615 ns/iter	1.52
Schema_Frame_OMC_Locations	20748879.14705628 ns/iter	13246462.5961531 ns/iter	1.57
Schema_Frame_ISO_Language_Locations	103303097.57143497 ns/iter	62533594.29999819 ns/iter	1.65
Schema_Frame_KrakenD_References	40433876.70588024 ns/iter	26579304.73076948 ns/iter	1.52
Schema_Frame_KrakenD_Reachable	572698625.0001574 ns/iter	551096997.0000588 ns/iter	1.04
Schema_Frame_ISO_Language_Locations_To_JSON	179129274.74998242 ns/iter	137695571.80003175 ns/iter	1.30
Schema_Frame_Many_Resources_References	366943944.0000133 ns/iter	268909803.66662616 ns/iter	1.36
Schema_Iterator_ISO_Language	3721934.032258652 ns/iter	2444104.2125429544 ns/iter	1.52
Schema_Tracker_ISO_Language	5318093.343284253 ns/iter	3733088.4861877263 ns/iter	1.42
Schema_Tracker_ISO_Language_To_JSON	26257217.307689782 ns/iter	18816328.83333219 ns/iter	1.40

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: e5c5c9a	Previous: 9d13de4	Ratio
E2E_Evaluator_adaptivecard	117124 ns	77731 ns	1.51
E2E_Evaluator_ansible-meta	538993 ns	316990 ns	1.70
E2E_Evaluator_aws-cdk	129970 ns	101064 ns	1.29
E2E_Evaluator_babelrc	314593 ns	246295 ns	1.28
E2E_Evaluator_cerebrum-criminal-case	2575631 ns	1524349 ns	1.69
E2E_Evaluator_clang-format	247573 ns	163776 ns	1.51
E2E_Evaluator_cmake-presets	18222261 ns	11796225 ns	1.54
E2E_Evaluator_code-climate	504268 ns	370018 ns	1.36
E2E_Evaluator_cql2	1261524 ns	771344 ns	1.64
E2E_Evaluator_cspell	1595358 ns	1056958 ns	1.51
E2E_Evaluator_cypress	814373 ns	546157 ns	1.49
E2E_Evaluator_deno	1066833 ns	698075 ns	1.53
E2E_Evaluator_dependabot	1067819 ns	657755 ns	1.62
E2E_Evaluator_draft-04	20357058 ns	12650912 ns	1.61
E2E_Evaluator_fabric-mod	2338706 ns	1466077 ns	1.60
E2E_Evaluator_geojson	24430303 ns	15161941 ns	1.61
E2E_Evaluator_gitpod-configuration	719986 ns	440732 ns	1.63
E2E_Evaluator_helm-chart-lock	996705 ns	671939 ns	1.48
E2E_Evaluator_importmap	258802 ns	211647 ns	1.22
E2E_Evaluator_jasmine	277877 ns	178772 ns	1.55
E2E_Evaluator_jsconfig	1473977 ns	801217 ns	1.84
E2E_Evaluator_jshintrc	2879825 ns	1846966 ns	1.56
E2E_Evaluator_krakend	643090 ns	397342 ns	1.62
E2E_Evaluator_lazygit	449751 ns	264349 ns	1.70
E2E_Evaluator_lerna	447991 ns	299867 ns	1.49
E2E_Evaluator_nest-cli	595195 ns	391822 ns	1.52
E2E_Evaluator_omc	96389 ns	67821 ns	1.42
E2E_Evaluator_omnisharp	1435059 ns	894388 ns	1.60
E2E_Evaluator_openapi	22511545 ns	13722586 ns	1.64
E2E_Evaluator_pre-commit-hooks	2015459 ns	1249061 ns	1.61
E2E_Evaluator_pulumi	1970775 ns	1364026 ns	1.44
E2E_Evaluator_semantic-release	223976 ns	157744 ns	1.42
E2E_Evaluator_stale	377808 ns	246885 ns	1.53
E2E_Evaluator_stylecop	1171590 ns	836543 ns	1.40
E2E_Evaluator_tmuxinator	218056 ns	169026 ns	1.29
E2E_Evaluator_ui5	2203422 ns	1529570 ns	1.44
E2E_Evaluator_ui5-manifest	9761100 ns	7054435 ns	1.38
E2E_Evaluator_unreal-engine-uproject	1630736 ns	968014 ns	1.68
E2E_Evaluator_users-array	2886828 ns	2116020 ns	1.36
E2E_Evaluator_vercel	992643 ns	633869 ns	1.57
E2E_Evaluator_yamllint	23743 ns	17368 ns	1.37

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: e5c5c9a	Previous: 9d13de4	Ratio
Schema_Iterator_ISO_Language	3119180.3955552033 ns/iter	3183752.407724768 ns/iter	0.98
Schema_Tracker_ISO_Language	4741987.213333231 ns/iter	4515333.077921394 ns/iter	1.05
Schema_Tracker_ISO_Language_To_JSON	20328025.911764517 ns/iter	21186250.606061466 ns/iter	0.96
Schema_Frame_WoT_References	4722459.261745295 ns/iter	4550274.941557113 ns/iter	1.04
Schema_Frame_OMC_References	20669052.11764566 ns/iter	19537218.285716206 ns/iter	1.06
Schema_Frame_OMC_Locations	19084989.54054033 ns/iter	17968546.025643334 ns/iter	1.06
Schema_Frame_ISO_Language_Locations	102037193.16668488 ns/iter	96832929.57142189 ns/iter	1.05
Schema_Frame_KrakenD_References	41902783.588237554 ns/iter	35699093.68421146 ns/iter	1.17
Schema_Frame_KrakenD_Reachable	606427378.0000349 ns/iter	536872668.9998766 ns/iter	1.13
Schema_Frame_ISO_Language_Locations_To_JSON	124372416.0000094 ns/iter	115748367.00001469 ns/iter	1.07
Schema_Frame_Many_Resources_References	358681167.50003767 ns/iter	344755344.9999532 ns/iter	1.04
Schema_Bundle_Meta_2020_12	1466277.4696003846 ns/iter	1461691.1583260617 ns/iter	1.00
Schema_Format_ISO_Language_To_JSON	112570669.99998719 ns/iter	103017336.000026 ns/iter	1.09
E2E_Compiler_adaptivecard	58601999.500003405 ns/iter	56536599.166652955 ns/iter	1.04
E2E_Compiler_ansible_meta	25853626.3703701 ns/iter	24812937.607147694 ns/iter	1.04
E2E_Compiler_aws_cdk	312189.73526786646 ns/iter	327058.6758524643 ns/iter	0.95
E2E_Compiler_babelrc	2329623.870432034 ns/iter	2313182.6225168477 ns/iter	1.01
E2E_Compiler_clang_format	16538432.49999909 ns/iter	16259780.720929485 ns/iter	1.02
E2E_Compiler_cmake_presets	26051455.925922982 ns/iter	25160699.99999807 ns/iter	1.04
E2E_Compiler_code_climate	2382414.5838927855 ns/iter	2326675.362126123 ns/iter	1.02
E2E_Compiler_cql2	13050259.88888794 ns/iter	12911923.611113707 ns/iter	1.01
E2E_Compiler_cspell	23207244.866667528 ns/iter	22625140.41935461 ns/iter	1.03
E2E_Compiler_cypress	3966534.4237288996 ns/iter	3925918.668538757 ns/iter	1.01
E2E_Compiler_deno	7140148.102041389 ns/iter	7008446.540000932 ns/iter	1.02
E2E_Compiler_dependabot	3560748.372449302 ns/iter	3513578.180904938 ns/iter	1.01
E2E_Compiler_draft_04	2425851.3425605856 ns/iter	2430900.7083331835 ns/iter	1.00
E2E_Compiler_fabric_mod	4275770.499999653 ns/iter	4254012.17073225 ns/iter	1.01
E2E_Compiler_geojson	20868755.382353168 ns/iter	19980868.514286548 ns/iter	1.04
E2E_Compiler_gitpod_configuration	4579616.07843144 ns/iter	4507822.915583902 ns/iter	1.02
E2E_Compiler_helm_chart_lock	594824.444160277 ns/iter	619935.7291296702 ns/iter	0.96
E2E_Compiler_importmap	231866.86192054022 ns/iter	244850.13982603446 ns/iter	0.95
E2E_Compiler_jasmine	1203135.9501718138 ns/iter	1221711.8446773365 ns/iter	0.98
E2E_Compiler_jshintrc	3819371.9945360487 ns/iter	3847499.4890101203 ns/iter	0.99
E2E_Compiler_jsconfig	20378508.411765244 ns/iter	20065016.79999409 ns/iter	1.02
E2E_Compiler_krakend	140053140.9999985 ns/iter	134331272.6000022 ns/iter	1.04
E2E_Compiler_lazygit	31292643.318186656 ns/iter	29951991.86956716 ns/iter	1.04
E2E_Compiler_lerna	1418395.0991903965 ns/iter	1427085.2361396821 ns/iter	0.99
E2E_Compiler_nest_cli	6791125.067308074 ns/iter	6690247.828570743 ns/iter	1.02
E2E_Compiler_omc	153174512.49998724 ns/iter	145340571.99998644 ns/iter	1.05
E2E_Compiler_omnisharp	6051981.974137718 ns/iter	6022104.025639711 ns/iter	1.00
E2E_Compiler_openapi	23186752.733333074 ns/iter	22768290.967735905 ns/iter	1.02
E2E_Compiler_pre_commit_hooks	4685480.033557779 ns/iter	4662263.973333817 ns/iter	1.00
E2E_Compiler_pulumi	3631475.57512946 ns/iter	3607075.438144561 ns/iter	1.01
E2E_Compiler_semantic_release	1364407.595330858 ns/iter	1377793.996055245 ns/iter	0.99
E2E_Compiler_stale	1394111.3511904068 ns/iter	1424886.4760916082 ns/iter	0.98
E2E_Compiler_stylecop	5345882.86153796 ns/iter	5184310.659259845 ns/iter	1.03
E2E_Compiler_tmuxinator	1687266.1783131058 ns/iter	1689532.4126211854 ns/iter	1.00
E2E_Compiler_ui5	51261204.69230954 ns/iter	46003368.26667141 ns/iter	1.11
E2E_Compiler_ui5_manifest	332407670.99999857 ns/iter	293254633.5000552 ns/iter	1.13
E2E_Compiler_unreal_engine_uproject	4162203.535714292 ns/iter	4142294.135293496 ns/iter	1.00
E2E_Compiler_users_array	756923.0639912452 ns/iter	789641.8566590234 ns/iter	0.96
E2E_Compiler_vercel	12364474.263158469 ns/iter	12082969.39655062 ns/iter	1.02
E2E_Compiler_yamllint	286092.2061349839 ns/iter	304147.93518930103 ns/iter	0.94
E2E_Evaluator_adaptivecard	26182.564522861692 ns/iter	26430.73837014075 ns/iter	0.99
E2E_Evaluator_ansible_meta	220946.8981481566 ns/iter	243265.31606586283 ns/iter	0.91
E2E_Evaluator_aws_cdk	46117.77114622158 ns/iter	55173.63960135797 ns/iter	0.84
E2E_Evaluator_babelrc	97640.59336040742 ns/iter	126496.5497372555 ns/iter	0.77
E2E_Evaluator_cerebrum_criminal_case	1132088.8060897717 ns/iter	1042343.7846608352 ns/iter	1.09
E2E_Evaluator_clang_format	114657.86822338935 ns/iter	120348.16875850208 ns/iter	0.95
E2E_Evaluator_cmake_presets	4999014.338983539 ns/iter	4512234.848101499 ns/iter	1.11
E2E_Evaluator_code_climate	164170.4683632923 ns/iter	194778.36203524095 ns/iter	0.84
E2E_Evaluator_cql2	196885.70250694646 ns/iter	225955.42738056515 ns/iter	0.87
E2E_Evaluator_cspell	622922.1624087513 ns/iter	639801.7862941327 ns/iter	0.97
E2E_Evaluator_cypress	177551.67616905487 ns/iter	202141.9335825085 ns/iter	0.88
E2E_Evaluator_deno	263845.7328301675 ns/iter	347969.33349783154 ns/iter	0.76
E2E_Evaluator_dependabot	326892.00513539405 ns/iter	342349.62512168894 ns/iter	0.95
E2E_Evaluator_draft_04	11898011.890910065 ns/iter	8228560.329546946 ns/iter	1.45
E2E_Evaluator_fabric_mod	681788.1183550825 ns/iter	720491.1348547877 ns/iter	0.95
E2E_Evaluator_geojson	18424864.6842087 ns/iter	16891275.309522565 ns/iter	1.09
E2E_Evaluator_gitpod_configuration	221074.988993715 ns/iter	247743.2441083423 ns/iter	0.89
E2E_Evaluator_helm_chart_lock	227159.97243838868 ns/iter	311500.7515723459 ns/iter	0.73
E2E_Evaluator_importmap	52204.85038725103 ns/iter	51748.96819520988 ns/iter	1.01
E2E_Evaluator_jasmine	102212.56961285039 ns/iter	115008.58437091553 ns/iter	0.89
E2E_Evaluator_jshintrc	1186234.0864406363 ns/iter	1218603.0278747934 ns/iter	0.97
E2E_Evaluator_jsconfig	416358.26197515195 ns/iter	445190.38116316247 ns/iter	0.94
E2E_Evaluator_krakend	192128.60747407892 ns/iter	222478.94201033018 ns/iter	0.86
E2E_Evaluator_lazygit	132356.91617676822 ns/iter	150945.18418155392 ns/iter	0.88
E2E_Evaluator_lerna	116123.0739571242 ns/iter	151037.6197849485 ns/iter	0.77
E2E_Evaluator_nest_cli	185599.40481284997 ns/iter	196467.626472247 ns/iter	0.94
E2E_Evaluator_omc	18758.560942163662 ns/iter	19706.784993485846 ns/iter	0.95
E2E_Evaluator_omnisharp	566058.3147377047 ns/iter	618178.9104609736 ns/iter	0.92
E2E_Evaluator_openapi	13491826.942308413 ns/iter	11610235.808217261 ns/iter	1.16
E2E_Evaluator_pre_commit_hooks	506813.78055756225 ns/iter	492220.9922481326 ns/iter	1.03
E2E_Evaluator_pulumi	693861.9441675197 ns/iter	713587.1902338292 ns/iter	0.97
E2E_Evaluator_semantic_release	88337.88818010771 ns/iter	106135.69500003105 ns/iter	0.83
E2E_Evaluator_stale	154438.76773327368 ns/iter	168564.5076705137 ns/iter	0.92
E2E_Evaluator_stylecop	274554.522683186 ns/iter	301262.0903535312 ns/iter	0.91
E2E_Evaluator_tmuxinator	86147.38125849793 ns/iter	101889.9369930508 ns/iter	0.85
E2E_Evaluator_ui5	516726.5804597663 ns/iter	533315.0362934192 ns/iter	0.97
E2E_Evaluator_ui5_manifest	2575382.1753734085 ns/iter	2573579.955223841 ns/iter	1.00
E2E_Evaluator_unreal_engine_uproject	462326.6651927053 ns/iter	446311.6486657651 ns/iter	1.04
E2E_Evaluator_users_array	634899.001000008 ns/iter	567613.0711972483 ns/iter	1.12
E2E_Evaluator_vercel	282112.62342620466 ns/iter	323473.00138060434 ns/iter	0.87
E2E_Evaluator_yamllint	8660.662338146258 ns/iter	9350.00040905301 ns/iter	0.93
JSONLD_Catalog	27565053.576923814 ns/iter	23762492.29999606 ns/iter	1.16
Micro_Draft4_Meta_1_No_Callback	206.61431406405978 ns/iter	199.07965709623747 ns/iter	1.04
Micro_Draft4_Required_Properties	918.534944579312 ns/iter	854.4183969978353 ns/iter	1.08
Micro_Draft4_Many_Optional_Properties_Minimal_Match	26.429015978943045 ns/iter	23.523440961936295 ns/iter	1.12
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.740176400006263 ns/iter	11.836211092972992 ns/iter	0.99
Micro_Draft4_Items_Schema	271.97197197319457 ns/iter	274.2078509523847 ns/iter	0.99
Micro_Draft4_Nested_Object	1.3031053448247563 ns/iter	1.8136125166764 ns/iter	0.72
Micro_Draft4_Properties_Triad_Optional	327.7947699232541 ns/iter	328.58164587265003 ns/iter	1.00
Micro_Draft4_Properties_Triad_Closed	272.3755300618561 ns/iter	275.7685378465292 ns/iter	0.99
Micro_Draft4_Properties_Triad_Required	343.73187255790344 ns/iter	356.4162570423656 ns/iter	0.96
Micro_Draft4_Properties_Closed	64.70739333134813 ns/iter	65.21804778071254 ns/iter	0.99
Micro_Draft4_Non_Recursive_Ref	21.539153388337766 ns/iter	14.531580978388778 ns/iter	1.48
Micro_Draft4_Pattern_Properties_True	144.14533282492258 ns/iter	153.85560505328723 ns/iter	0.94
Micro_Draft4_Ref_To_Single_Property	11.770908689982948 ns/iter	11.94392233357324 ns/iter	0.99
Micro_Draft4_Additional_Properties_Type	37.95811835282965 ns/iter	33.36938889018543 ns/iter	1.14
Micro_Draft4_Nested_Oneof	57.676540859742126 ns/iter	60.14918995208406 ns/iter	0.96
Micro_Draft4_Short_Enum	10.918943664546601 ns/iter	9.967851143118056 ns/iter	1.10
Micro_Draft4_Long_Enum	14.299315733379759 ns/iter	14.651338985216006 ns/iter	0.98
Micro_Draft4_Long_Enum_Short_Strings	10.91373529319731 ns/iter	9.974651218175966 ns/iter	1.09
Micro_Draft4_Type_Object	3.5253345773178517 ns/iter	3.426219293852522 ns/iter	1.03
Micro_Draft4_Ref_Single_100	2335188.053156528 ns/iter	2378800.665540568 ns/iter	0.98
Micro_Draft4_Compile_Ref_Many_Nested	1707176.1442538886 ns/iter	1722960.6928751299 ns/iter	0.99
Micro_Draft4_Compile_Wrap	2345037.902684618 ns/iter	2351747.6060612844 ns/iter	1.00
Micro_Draft6_Property_Names	123.80511967804156 ns/iter	126.81981491228575 ns/iter	0.98
Micro_Draft6_Compile_FHIR	16624354791.000088 ns/iter	13808646288.999853 ns/iter	1.20
Micro_Draft7_If_Then_Else	25.636003695118315 ns/iter	24.928468239880242 ns/iter	1.03
Micro_2019_09_Unevaluated_Properties	24.725140281006258 ns/iter	27.42038941503526 ns/iter	0.90
Micro_2019_09_Compile_Wrap	323985932.0000278 ns/iter	278651515.33334637 ns/iter	1.16
Micro_2020_12_Dynamic_Ref	721.6865299259346 ns/iter	704.5817370014198 ns/iter	1.02
Micro_2020_12_Dynamic_Ref_Single	3.5480558851248234 ns/iter	3.435341681770653 ns/iter	1.03
Micro_2020_12_Simple_Output_Mask	1031.4169532966494 ns/iter	1087.4248817497314 ns/iter	0.95
Micro_2020_12_Simple_Output_Annotations	61642.0907009621 ns/iter	103201.3051097021 ns/iter	0.60
Micro_2020_12_Simple_Output_Annotation_Dropping	1556025.4348782082 ns/iter	12516372.428572303 ns/iter	0.12
Micro_2020_12_Compile_NonCircular_Shared_Refs	957441.6286107206 ns/iter	981947.0462831282 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric	8508.617518731178 ns/iter	8321.62378197951 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	43871.22541340338 ns/iter	70589.2180871909 ns/iter	0.62
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22879.110634398923 ns/iter	22771.620118612453 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	156.49337144160447 ns/iter	144.8768215346636 ns/iter	1.08
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	2560.21023359317 ns/iter	4299.251500922776 ns/iter	0.60
Alterschema_Check_Readibility_ISO_Language_Set_3	367095068.499907 ns/iter	354937269.9999367 ns/iter	1.03
Alterschema_Check_Readibility_OMC	94203620.49999653 ns/iter	84438312.37499921 ns/iter	1.12
Alterschema_Check_Readibility_KrakenD	1362617107.999995 ns/iter	1179843333.000008 ns/iter	1.15
Alterschema_Apply_Readibility_KrakenD	135153003055 ns/iter	118820531176.99979 ns/iter	1.14
Alterschema_Check_Invalid_External_Refs	279057924.50007993 ns/iter	300763363.499982 ns/iter	0.93

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: e5c5c9a	Previous: 9d13de4	Ratio
E2E_Evaluator_adaptivecard	118241 ns	118949 ns	0.99
E2E_Evaluator_ansible-meta	572759 ns	527958 ns	1.08
E2E_Evaluator_aws-cdk	133943 ns	143295 ns	0.93
E2E_Evaluator_babelrc	343374 ns	367501 ns	0.93
E2E_Evaluator_cerebrum-criminal-case	2785012 ns	2557711 ns	1.09
E2E_Evaluator_clang-format	256806 ns	273528 ns	0.94
E2E_Evaluator_cmake-presets	20732038 ns	18247614 ns	1.14
E2E_Evaluator_code-climate	521051 ns	514912 ns	1.01
E2E_Evaluator_cql2	1296147 ns	1324915 ns	0.98
E2E_Evaluator_cspell	1696990 ns	1456578 ns	1.17
E2E_Evaluator_cypress	857232 ns	782490 ns	1.10
E2E_Evaluator_deno	1070319 ns	1055652 ns	1.01
E2E_Evaluator_dependabot	1160100 ns	1119582 ns	1.04
E2E_Evaluator_draft-04	24422186 ns	20413117 ns	1.20
E2E_Evaluator_fabric-mod	2630157 ns	2356827 ns	1.12
E2E_Evaluator_geojson	25959168 ns	22299280 ns	1.16
E2E_Evaluator_gitpod-configuration	746137 ns	720353 ns	1.04
E2E_Evaluator_helm-chart-lock	1007685 ns	1096379 ns	0.92
E2E_Evaluator_importmap	270506 ns	268360 ns	1.01
E2E_Evaluator_jasmine	285540 ns	289319 ns	0.99
E2E_Evaluator_jsconfig	1465835 ns	1226646 ns	1.19
E2E_Evaluator_jshintrc	2962190 ns	2775358 ns	1.07
E2E_Evaluator_krakend	648530 ns	663615 ns	0.98
E2E_Evaluator_lazygit	498217 ns	507456 ns	0.98
E2E_Evaluator_lerna	449297 ns	462299 ns	0.97
E2E_Evaluator_nest-cli	626767 ns	589828 ns	1.06
E2E_Evaluator_omc	96266 ns	96822 ns	0.99
E2E_Evaluator_omnisharp	1488743 ns	1423541 ns	1.05
E2E_Evaluator_openapi	23406154 ns	23361094 ns	1.00
E2E_Evaluator_pre-commit-hooks	2095122 ns	2055959 ns	1.02
E2E_Evaluator_pulumi	2001265 ns	1877986 ns	1.07
E2E_Evaluator_semantic-release	228715 ns	249223 ns	0.92
E2E_Evaluator_stale	385684 ns	399338 ns	0.97
E2E_Evaluator_stylecop	1178438 ns	1221021 ns	0.97
E2E_Evaluator_tmuxinator	225037 ns	231515 ns	0.97
E2E_Evaluator_ui5	2170273 ns	2234436 ns	0.97
E2E_Evaluator_ui5-manifest	13418787 ns	10383642 ns	1.29
E2E_Evaluator_unreal-engine-uproject	1708763 ns	1524276 ns	1.12
E2E_Evaluator_users-array	2824560 ns	2965119 ns	0.95
E2E_Evaluator_vercel	1015652 ns	991638 ns	1.02
E2E_Evaluator_yamllint	24404 ns	25743 ns	0.95

This comment was automatically generated by workflow using github-action-benchmark.

[augmentcode]

🤖 Augment PR Summary

Summary: Prevents SimpleOutput from leaking schema annotations produced by failing branches/units during evaluation (notably impacting JSON-LD annotation materialization).

Changes:

• Replace the previous mask + masked_traces map with a MaskEntry stack that also records an annotations_mark and buffers traces per active branching keyword.
• Add failure-time pruning to drop annotations collected by the failing “unit” within anyOf, oneOf, contains, if, and not (including nested instance locations where applicable).
• Keep trace masking behavior, but move buffered-trace ownership into the stack entries themselves.
• Add regression tests for JSON-LD anyOf failures and for SimpleOutput annotation behavior across anyOf/oneOf/if and whitelisted annotations.

Technical Notes: The pruning logic identifies the nearest active branching keyword (reverse scan of the mask stack) and erases annotations starting at the keyword’s recorded mark.

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. 1 suggestion posted.

Comment augment review to trigger a new review at any time.

[augmentcode]

annotations_ stores effective_evaluate_path (resolved via base_), but this pruning compares entry.evaluate_path against the raw evaluate_path (unresolved). If SimpleOutput is constructed with a matching base_ (e.g. in fail_string_with_matching_base-style usage), this can prevent failed-unit annotation pruning from matching and could reintroduce annotation leaks.

Severity: medium

_{🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.}

[cubic-dev-ai]

All reported issues were addressed

<sub>Reply with feedback, questions, or to request a fix.

Re-trigger cubic</sub>

[cubic-dev-ai]

All reported issues were addressed across 4 files

<sub>Reply with feedback, questions, or to request a fix.

Re-trigger cubic</sub>