Support evaluator callbacks in the JavaScript port

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: e5b64c9	Previous: 7558ff3	Ratio
E2E_Compiler_adaptivecard	64639878.00000521 ns/iter	64092791.444447055 ns/iter	1.01
E2E_Compiler_ansible_meta	28598620.041667763 ns/iter	29365019.37499969 ns/iter	0.97
E2E_Compiler_aws_cdk	374553.0979133346 ns/iter	380172.6507150783 ns/iter	0.99
E2E_Compiler_babelrc	2551079.0912407935 ns/iter	2597753.555555629 ns/iter	0.98
E2E_Compiler_clang_format	18083874.05128105 ns/iter	18307796.421052407 ns/iter	0.99
E2E_Compiler_cmake_presets	25293063.03571437 ns/iter	25592921.81481438 ns/iter	0.99
E2E_Compiler_code_climate	2547883.418181879 ns/iter	2588132.2693727287 ns/iter	0.98
E2E_Compiler_cql2	12686195.890909279 ns/iter	12916457.574073514 ns/iter	0.98
E2E_Compiler_cspell	22462111.516129043 ns/iter	22935624.741935056 ns/iter	0.98
E2E_Compiler_cypress	3871016.7016572934 ns/iter	3935591.6179774436 ns/iter	0.98
E2E_Compiler_deno	7675942.626373658 ns/iter	7805506.933333265 ns/iter	0.98
E2E_Compiler_dependabot	3873470.812154589 ns/iter	3923140.011235947 ns/iter	0.99
E2E_Compiler_draft_04	2663850.0684410282 ns/iter	2708392.5813952265 ns/iter	0.98
E2E_Compiler_fabric_mod	4711478.18120813 ns/iter	4762652.57823134 ns/iter	0.99
E2E_Compiler_geojson	21745791.312500983 ns/iter	22088224.53124881 ns/iter	0.98
E2E_Compiler_gitpod_configuration	4866812.930069605 ns/iter	4940851.7464790195 ns/iter	0.99
E2E_Compiler_helm_chart_lock	699507.0110331429 ns/iter	720018.259713681 ns/iter	0.97
E2E_Compiler_importmap	285008.8296747938 ns/iter	289917.9664318264 ns/iter	0.98
E2E_Compiler_jasmine	1356269.6557060236 ns/iter	1379573.1222880734 ns/iter	0.98
E2E_Compiler_jshintrc	4319524.69135814 ns/iter	4401364.518750128 ns/iter	0.98
E2E_Compiler_jsconfig	21662887.218749207 ns/iter	21991079.406250335 ns/iter	0.99
E2E_Compiler_krakend	142977479.39999682 ns/iter	138841194.99999768 ns/iter	1.03
E2E_Compiler_lazygit	33022401.71428496 ns/iter	33388278.523808543 ns/iter	0.99
E2E_Compiler_lerna	1579286.876404551 ns/iter	1604034.2683486561 ns/iter	0.98
E2E_Compiler_nest_cli	7363163.452631445 ns/iter	7458705.193548373 ns/iter	0.99
E2E_Compiler_omc	153708358.00000292 ns/iter	156523286.50000414 ns/iter	0.98
E2E_Compiler_omnisharp	6692514.866666616 ns/iter	6756800.903846081 ns/iter	0.99
E2E_Compiler_openapi	24829851.071428623 ns/iter	25086032.714286588 ns/iter	0.99
E2E_Compiler_pre_commit_hooks	5283749.901515262 ns/iter	5359717.114503945 ns/iter	0.99
E2E_Compiler_pulumi	4016643.5028569526 ns/iter	4068780.5988373486 ns/iter	0.99
E2E_Compiler_semantic_release	1563827.2790178421 ns/iter	1584697.3582765537 ns/iter	0.99
E2E_Compiler_stale	1548264.5827814578 ns/iter	1574118.6771301033 ns/iter	0.98
E2E_Compiler_stylecop	6165139.900901096 ns/iter	6233247.3571424475 ns/iter	0.99
E2E_Compiler_tmuxinator	1910389.6547945836 ns/iter	1949967.66944434 ns/iter	0.98
E2E_Compiler_ui5	46976615.13333363 ns/iter	47238452.13333107 ns/iter	0.99
E2E_Compiler_ui5_manifest	313207036.50001746 ns/iter	316679133.9999975 ns/iter	0.99
E2E_Compiler_unreal_engine_uproject	4559304.764706097 ns/iter	4632172.5102041075 ns/iter	0.98
E2E_Compiler_vercel	12265744.29824623 ns/iter	12461345.42857139 ns/iter	0.98
E2E_Compiler_yamllint	345034.22178414126 ns/iter	352462.0368686654 ns/iter	0.98
E2E_Evaluator_adaptivecard	25124.897549329067 ns/iter	24759.7654391749 ns/iter	1.01
E2E_Evaluator_ansible_meta	230120.31610535216 ns/iter	230123.7700164616 ns/iter	1.00
E2E_Evaluator_aws_cdk	49676.57197778824 ns/iter	55362.05053995673 ns/iter	0.90
E2E_Evaluator_babelrc	111735.61456848856 ns/iter	114576.07015857569 ns/iter	0.98
E2E_Evaluator_cerebrum_criminal_case	1223038.34536086 ns/iter	1200816.588850189 ns/iter	1.02
E2E_Evaluator_clang_format	125137.50250446543 ns/iter	125980.86945592034 ns/iter	0.99
E2E_Evaluator_cmake_presets	4309047.77848071 ns/iter	4183458.866666432 ns/iter	1.03
E2E_Evaluator_code_climate	171794.43424257662 ns/iter	169854.56630302934 ns/iter	1.01
E2E_Evaluator_cql2	216416.40907677426 ns/iter	219423.04433961888 ns/iter	0.99
E2E_Evaluator_cspell	545423.9680934097 ns/iter	547133.5558176223 ns/iter	1.00
E2E_Evaluator_cypress	192260.8398244659 ns/iter	192230.54200988894 ns/iter	1.00
E2E_Evaluator_deno	310165.28953227506 ns/iter	313436.8039215925 ns/iter	0.99
E2E_Evaluator_dependabot	426781.5116136657 ns/iter	418007.02313167125 ns/iter	1.02
E2E_Evaluator_draft_04	8071999.873563408 ns/iter	7681146.458333287 ns/iter	1.05
E2E_Evaluator_fabric_mod	721498.0906282254 ns/iter	723534.9496402902 ns/iter	1.00
E2E_Evaluator_geojson	16984385.166666914 ns/iter	16499209.49999942 ns/iter	1.03
E2E_Evaluator_gitpod_configuration	230182.0516957467 ns/iter	227615.17508967096 ns/iter	1.01
E2E_Evaluator_helm_chart_lock	350097.485014995 ns/iter	357506.52868851845 ns/iter	0.98
E2E_Evaluator_importmap	50018.88570000119 ns/iter	47942.91775483695 ns/iter	1.04
E2E_Evaluator_jasmine	115853.4196797085 ns/iter	115964.41379309697 ns/iter	1.00
E2E_Evaluator_jshintrc	1195707.6422486724 ns/iter	1197280.9349314603 ns/iter	1.00
E2E_Evaluator_jsconfig	430475.39069197205 ns/iter	429285.2997543226 ns/iter	1.00
E2E_Evaluator_krakend	208724.89538084975 ns/iter	212284.88663845306 ns/iter	0.98
E2E_Evaluator_lazygit	144360.1890256619 ns/iter	146412.13344418927 ns/iter	0.99
E2E_Evaluator_lerna	139275.57439585027 ns/iter	138031.75249853358 ns/iter	1.01
E2E_Evaluator_nest_cli	178099.91070522778 ns/iter	177042.2694273936 ns/iter	1.01
E2E_Evaluator_omc	18952.77411429217 ns/iter	18991.990905106006 ns/iter	1.00
E2E_Evaluator_omnisharp	606539.147136599 ns/iter	612656.794117633 ns/iter	0.99
E2E_Evaluator_openapi	15473783.604165921 ns/iter	13638597.83999942 ns/iter	1.13
E2E_Evaluator_pre_commit_hooks	466045.8747488177 ns/iter	467107.8475487215 ns/iter	1.00
E2E_Evaluator_pulumi	705445.141129017 ns/iter	705458.4863498844 ns/iter	1.00
E2E_Evaluator_semantic_release	101791.87540310837 ns/iter	109296.24361748436 ns/iter	0.93
E2E_Evaluator_stale	153399.12601452478 ns/iter	149129.27549270735 ns/iter	1.03
E2E_Evaluator_stylecop	282271.164112921 ns/iter	289513.19983449636 ns/iter	0.97
E2E_Evaluator_tmuxinator	96911.7213903003 ns/iter	96917.3305329894 ns/iter	1.00
E2E_Evaluator_ui5	506754.65994235605 ns/iter	496989.24002902483 ns/iter	1.02
E2E_Evaluator_ui5_manifest	2476829.6321427994 ns/iter	2456228.7797832405 ns/iter	1.01
E2E_Evaluator_unreal_engine_uproject	433194.39254656906 ns/iter	435405.18288903026 ns/iter	0.99
E2E_Evaluator_vercel	310062.69532290817 ns/iter	312097.6979027204 ns/iter	0.99
E2E_Evaluator_yamllint	8770.41304559435 ns/iter	8942.639090420707 ns/iter	0.98
Micro_Draft4_Meta_1_No_Callback	190.62410037995426 ns/iter	192.35338909150468 ns/iter	0.99
Micro_Draft4_Required_Properties	845.8942546454659 ns/iter	846.6991507014483 ns/iter	1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match	21.432553449537878 ns/iter	21.325543588010937 ns/iter	1.01
Micro_Draft4_Few_Optional_Properties_Minimal_Match	11.210905925977709 ns/iter	11.204540776712355 ns/iter	1.00
Micro_Draft4_Items_Schema	280.1904900513607 ns/iter	288.9799055730503 ns/iter	0.97
Micro_Draft4_Nested_Object	1.81658334294067 ns/iter	1.8119794751823914 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	332.8959510248136 ns/iter	331.18990813735246 ns/iter	1.01
Micro_Draft4_Properties_Triad_Closed	268.7686067725902 ns/iter	266.58590648653427 ns/iter	1.01
Micro_Draft4_Properties_Triad_Required	337.1402855273823 ns/iter	334.2608981524358 ns/iter	1.01
Micro_Draft4_Properties_Closed	54.855558355119854 ns/iter	54.827514644834864 ns/iter	1.00
Micro_Draft4_Non_Recursive_Ref	14.316219696531798 ns/iter	14.317600641686502 ns/iter	1.00
Micro_Draft4_Pattern_Properties_True	157.13916314753016 ns/iter	157.3260175446976 ns/iter	1.00
Micro_Draft4_Ref_To_Single_Property	11.203353997177679 ns/iter	11.207391216063924 ns/iter	1.00
Micro_Draft4_Additional_Properties_Type	28.295021153741683 ns/iter	28.340900684442968 ns/iter	1.00
Micro_Draft4_Nested_Oneof	56.33210345142952 ns/iter	56.329363876169545 ns/iter	1.00
Micro_Draft4_Short_Enum	11.832932106228895 ns/iter	11.90805684668874 ns/iter	0.99
Micro_Draft4_Long_Enum	14.96275287638399 ns/iter	14.952621741312765 ns/iter	1.00
Micro_Draft4_Long_Enum_Short_Strings	12.157506217757977 ns/iter	11.831982719594109 ns/iter	1.03
Micro_Draft4_Type_Object	3.734482017663384 ns/iter	3.736091783792596 ns/iter	1.00
Micro_Draft4_Ref_Single_100	2350241.0802676454 ns/iter	2400714.4212327516 ns/iter	0.98
Micro_Draft4_Compile_Ref_Many_Nested	1700156.755448081 ns/iter	1744702.3670886757 ns/iter	0.97
Micro_Draft4_Compile_Wrap	2338407.7766665234 ns/iter	2372926.37500006 ns/iter	0.99
Micro_Draft6_Property_Names	135.27993555180493 ns/iter	134.67912970260392 ns/iter	1.00
Micro_Draft6_Compile_FHIR	14182306917.000006 ns/iter	13807078009.000008 ns/iter	1.03
Micro_Draft7_If_Then_Else	23.996139991379625 ns/iter	23.968858412031068 ns/iter	1.00
Micro_2019_09_Unevaluated_Properties	27.572007478092274 ns/iter	27.592191509629014 ns/iter	1.00
Micro_2019_09_Compile_Wrap	293811626.50003034 ns/iter	304152943.5000143 ns/iter	0.97
Micro_2019_09_KrakenD_Linter_Check	1177554787.999952 ns/iter	1200893922.9999669 ns/iter	0.98
Micro_2019_09_KrakenD_Linter_Apply	10417546097.000013 ns/iter	10524158294.99995 ns/iter	0.99
Micro_2020_12_Dynamic_Ref	226.2923401113969 ns/iter	226.29161473503777 ns/iter	1.00
Micro_2020_12_Dynamic_Ref_Single	3.4255782023529187 ns/iter	3.4223777607950496 ns/iter	1.00
Micro_2020_12_Simple_Output_Mask	68523.20083276754 ns/iter	67081.07011845335 ns/iter	1.02
Micro_2020_12_Simple_Output_Annotations	104532.52980725848 ns/iter	102711.7997673409 ns/iter	1.02
Micro_2020_12_Compile_NonCircular_Shared_Refs	1092983.2018634037 ns/iter	1112681.34872618 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric	8395.737745380164 ns/iter	8128.379274743407 ns/iter	1.03
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	181829.84404390026 ns/iter	179308.82143776378 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22698.171085982893 ns/iter	22293.548002672596 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	143.73634273733663 ns/iter	142.4572744173181 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4412.7212991867955 ns/iter	4299.995250896769 ns/iter	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: e5b64c9	Previous: 7558ff3	Ratio
E2E_Evaluator_adaptivecard	129256 ns	109072 ns	1.19
E2E_Evaluator_ansible-meta	1169998 ns	957927 ns	1.22
E2E_Evaluator_aws-cdk	255801 ns	217469 ns	1.18
E2E_Evaluator_babelrc	525828 ns	416183 ns	1.26
E2E_Evaluator_cerebrum-criminal-case	5246551 ns	4267348 ns	1.23
E2E_Evaluator_clang-format	186733 ns	154181 ns	1.21
E2E_Evaluator_cmake-presets	20496761 ns	16198953 ns	1.27
E2E_Evaluator_code-climate	980424 ns	829099 ns	1.18
E2E_Evaluator_cql2	1333032 ns	1081149 ns	1.23
E2E_Evaluator_cspell	2286631 ns	1738300 ns	1.32
E2E_Evaluator_cypress	641649 ns	532374 ns	1.21
E2E_Evaluator_deno	1166744 ns	1027095 ns	1.14
E2E_Evaluator_dependabot	1885517 ns	1571704 ns	1.20
E2E_Evaluator_draft-04	26333932 ns	20033331 ns	1.31
E2E_Evaluator_fabric-mod	3748420 ns	3033717 ns	1.24
E2E_Evaluator_geojson	71392581 ns	52942437 ns	1.35
E2E_Evaluator_gitpod-configuration	1183905 ns	914689 ns	1.29
E2E_Evaluator_helm-chart-lock	1814703 ns	1445831 ns	1.26
E2E_Evaluator_importmap	533518 ns	409231 ns	1.30
E2E_Evaluator_jasmine	628530 ns	488169 ns	1.29
E2E_Evaluator_jsconfig	1659392 ns	1367839 ns	1.21
E2E_Evaluator_jshintrc	2138226 ns	1861035 ns	1.15
E2E_Evaluator_krakend	821160 ns	689399 ns	1.19
E2E_Evaluator_lazygit	599788 ns	489461 ns	1.23
E2E_Evaluator_lerna	688707 ns	542792 ns	1.27
E2E_Evaluator_nest-cli	1105904 ns	839370 ns	1.32
E2E_Evaluator_omc	114852 ns	85081 ns	1.35
E2E_Evaluator_omnisharp	1407081 ns	1186827 ns	1.19
E2E_Evaluator_openapi	47736904 ns	41702755 ns	1.14
E2E_Evaluator_pre-commit-hooks	1917459 ns	1513623 ns	1.27
E2E_Evaluator_pulumi	3403200 ns	2665505 ns	1.28
E2E_Evaluator_semantic-release	647656 ns	483337 ns	1.34
E2E_Evaluator_stale	753244 ns	578542 ns	1.30
E2E_Evaluator_stylecop	1287077 ns	989029 ns	1.30
E2E_Evaluator_tmuxinator	496419 ns	371595 ns	1.34
E2E_Evaluator_ui5	2822410 ns	2235943 ns	1.26
E2E_Evaluator_ui5-manifest	11368442 ns	10375568 ns	1.10
E2E_Evaluator_unreal-engine-uproject	2070546 ns	1706307 ns	1.21
E2E_Evaluator_vercel	1300284 ns	1110844 ns	1.17
E2E_Evaluator_yamllint	147561 ns	71372 ns	2.07

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: e5b64c9	Previous: 7558ff3	Ratio
E2E_Compiler_adaptivecard	63697537.500002004 ns/iter	95587141.70000258 ns/iter	0.67
E2E_Compiler_ansible_meta	26407032.40740971 ns/iter	36383625.00000117 ns/iter	0.73
E2E_Compiler_aws_cdk	312020.0451403327 ns/iter	492534.22940507054 ns/iter	0.63
E2E_Compiler_babelrc	2555685.3174604173 ns/iter	3670837.420560725 ns/iter	0.70
E2E_Compiler_clang_format	17903417.72499744 ns/iter	21337064.285713885 ns/iter	0.84
E2E_Compiler_cmake_presets	33717666.64999996 ns/iter	36736324.57895038 ns/iter	0.92
E2E_Compiler_code_climate	2376933.118081335 ns/iter	3839516.211822681 ns/iter	0.62
E2E_Compiler_cql2	15024682.017542943 ns/iter	19511552.083334513 ns/iter	0.77
E2E_Compiler_cspell	22854976.00000023 ns/iter	28169463.15384537 ns/iter	0.81
E2E_Compiler_cypress	4006368.8343192036 ns/iter	4847938.076388737 ns/iter	0.83
E2E_Compiler_deno	8965267.270270063 ns/iter	8624514.180850953 ns/iter	1.04
E2E_Compiler_dependabot	4310321.923566868 ns/iter	4867776.768212073 ns/iter	0.89
E2E_Compiler_draft_04	2361155.5238096192 ns/iter	2751134.1796610593 ns/iter	0.86
E2E_Compiler_fabric_mod	4184849.9999993937 ns/iter	4882601.495725997 ns/iter	0.86
E2E_Compiler_geojson	28505328.499997735 ns/iter	34144810.75000235 ns/iter	0.83
E2E_Compiler_gitpod_configuration	5058222.107438329 ns/iter	5560222.862384662 ns/iter	0.91
E2E_Compiler_helm_chart_lock	654573.3571977726 ns/iter	767158.436669598 ns/iter	0.85
E2E_Compiler_importmap	231322.32838042 ns/iter	272094.0509393037 ns/iter	0.85
E2E_Compiler_jasmine	1351168.0033784583 ns/iter	1913550.7518794977 ns/iter	0.71
E2E_Compiler_jshintrc	3772947.7658536425 ns/iter	4516073.971014679 ns/iter	0.84
E2E_Compiler_jsconfig	22618234.37499899 ns/iter	25187507.4642872 ns/iter	0.90
E2E_Compiler_krakend	150796114.7499941 ns/iter	178394491.59998822 ns/iter	0.85
E2E_Compiler_lazygit	41233600.36364105 ns/iter	42732649.52941163 ns/iter	0.96
E2E_Compiler_lerna	1624350.852652088 ns/iter	2020824.7729731344 ns/iter	0.80
E2E_Compiler_nest_cli	7107815.582608252 ns/iter	8899673.330000723 ns/iter	0.80
E2E_Compiler_omc	197311986.3333371 ns/iter	232918819.33331144 ns/iter	0.85
E2E_Compiler_omnisharp	7946912.097561769 ns/iter	8702657.46753275 ns/iter	0.91
E2E_Compiler_openapi	30184318.319998056 ns/iter	36175150.4444467 ns/iter	0.83
E2E_Compiler_pre_commit_hooks	5990442.863636093 ns/iter	5764959.745763116 ns/iter	1.04
E2E_Compiler_pulumi	4592951.290540847 ns/iter	4991614.585526648 ns/iter	0.92
E2E_Compiler_semantic_release	1648635.3575526467 ns/iter	2108927.054794312 ns/iter	0.78
E2E_Compiler_stale	1509797.6555119301 ns/iter	2119121.0962026073 ns/iter	0.71
E2E_Compiler_stylecop	6408618.206521673 ns/iter	7936100.989129698 ns/iter	0.81
E2E_Compiler_tmuxinator	1645853.855010644 ns/iter	2343652.895480367 ns/iter	0.70
E2E_Compiler_ui5	65283852.53845779 ns/iter	83895885.37500003 ns/iter	0.78
E2E_Compiler_ui5_manifest	342320437.49995 ns/iter	573250708.9999217 ns/iter	0.60
E2E_Compiler_unreal_engine_uproject	4819419.713483006 ns/iter	5676138.365671833 ns/iter	0.85
E2E_Compiler_vercel	18024260.67441967 ns/iter	17592181.46666828 ns/iter	1.02
E2E_Compiler_yamllint	315032.4292452412 ns/iter	366086.1638814145 ns/iter	0.86
E2E_Evaluator_adaptivecard	25248.24152568465 ns/iter	24277.75317640722 ns/iter	1.04
E2E_Evaluator_ansible_meta	200519.41312147956 ns/iter	216545.9060806685 ns/iter	0.93
E2E_Evaluator_aws_cdk	40918.54908620802 ns/iter	47408.705369529576 ns/iter	0.86
E2E_Evaluator_babelrc	122638.73093822085 ns/iter	114101.95799352982 ns/iter	1.07
E2E_Evaluator_cerebrum_criminal_case	1111716.3284133498 ns/iter	1280447.7060812488 ns/iter	0.87
E2E_Evaluator_clang_format	110126.07971133055 ns/iter	134602.0964717838 ns/iter	0.82
E2E_Evaluator_cmake_presets	3990883.4269660953 ns/iter	3881498.708074246 ns/iter	1.03
E2E_Evaluator_code_climate	149642.73219176952 ns/iter	152642.6032110181 ns/iter	0.98
E2E_Evaluator_cql2	185911.78964862836 ns/iter	215956.61613188052 ns/iter	0.86
E2E_Evaluator_cspell	524791.0800594268 ns/iter	737490.2836133919 ns/iter	0.71
E2E_Evaluator_cypress	155902.91145073192 ns/iter	208041.09668591266 ns/iter	0.75
E2E_Evaluator_deno	245091.30749438494 ns/iter	326789.7981727454 ns/iter	0.75
E2E_Evaluator_dependabot	438086.08463383163 ns/iter	400702.5289367648 ns/iter	1.09
E2E_Evaluator_draft_04	7480769.680556579 ns/iter	7588008.3272729525 ns/iter	0.99
E2E_Evaluator_fabric_mod	558223.7523398836 ns/iter	809083.7001762617 ns/iter	0.69
E2E_Evaluator_geojson	12522620.454546995 ns/iter	15307131.410252577 ns/iter	0.82
E2E_Evaluator_gitpod_configuration	151583.2517954463 ns/iter	215292.33092654 ns/iter	0.70
E2E_Evaluator_helm_chart_lock	191838.8896687567 ns/iter	223709.1444672299 ns/iter	0.86
E2E_Evaluator_importmap	31090.349358818527 ns/iter	30408.20460275999 ns/iter	1.02
E2E_Evaluator_jasmine	80482.21299517364 ns/iter	79893.54331236625 ns/iter	1.01
E2E_Evaluator_jshintrc	928058.7965862015 ns/iter	912934.1763944635 ns/iter	1.02
E2E_Evaluator_jsconfig	322615.01538458973 ns/iter	295949.1621377483 ns/iter	1.09
E2E_Evaluator_krakend	125640.0945127284 ns/iter	168254.9665711365 ns/iter	0.75
E2E_Evaluator_lazygit	94457.46417786388 ns/iter	125915.14767693031 ns/iter	0.75
E2E_Evaluator_lerna	117029.08197548671 ns/iter	111639.35580219522 ns/iter	1.05
E2E_Evaluator_nest_cli	133075.47928892158 ns/iter	137245.10532707316 ns/iter	0.97
E2E_Evaluator_omc	13984.488645308784 ns/iter	14024.420099463887 ns/iter	1.00
E2E_Evaluator_omnisharp	429145.9096459156 ns/iter	423132.0637349277 ns/iter	1.01
E2E_Evaluator_openapi	8047870.588236893 ns/iter	8170692.348839175 ns/iter	0.98
E2E_Evaluator_pre_commit_hooks	320381.2743966912 ns/iter	334818.8196171982 ns/iter	0.96
E2E_Evaluator_pulumi	569570.1263073435 ns/iter	536650.350877129 ns/iter	1.06
E2E_Evaluator_semantic_release	71045.46059646591 ns/iter	74149.40887686533 ns/iter	0.96
E2E_Evaluator_stale	106477.6623479127 ns/iter	110306.69388071804 ns/iter	0.97
E2E_Evaluator_stylecop	212638.37535015552 ns/iter	184864.1091051448 ns/iter	1.15
E2E_Evaluator_tmuxinator	65140.36731632325 ns/iter	68952.79058105982 ns/iter	0.94
E2E_Evaluator_ui5	330241.1224696029 ns/iter	327411.21794228075 ns/iter	1.01
E2E_Evaluator_ui5_manifest	1408384.221327977 ns/iter	2173685.380614992 ns/iter	0.65
E2E_Evaluator_unreal_engine_uproject	293187.74153139273 ns/iter	312086.1047190875 ns/iter	0.94
E2E_Evaluator_vercel	215842.99586410262 ns/iter	270021.4259992734 ns/iter	0.80
E2E_Evaluator_yamllint	5632.626945126793 ns/iter	6066.72235693758 ns/iter	0.93
Micro_Draft4_Meta_1_No_Callback	122.4475573269125 ns/iter	138.31923490580513 ns/iter	0.89
Micro_Draft4_Required_Properties	603.2956042874432 ns/iter	639.1773473403609 ns/iter	0.94
Micro_Draft4_Many_Optional_Properties_Minimal_Match	14.948089395040308 ns/iter	16.618228573623146 ns/iter	0.90
Micro_Draft4_Few_Optional_Properties_Minimal_Match	6.680203902835051 ns/iter	7.17274652948576 ns/iter	0.93
Micro_Draft4_Items_Schema	244.6807235454209 ns/iter	292.20191062042755 ns/iter	0.84
Micro_Draft4_Nested_Object	0.6664598060220499 ns/iter	0.835663453431083 ns/iter	0.80
Micro_Draft4_Properties_Triad_Optional	190.32237402125352 ns/iter	249.161639070554 ns/iter	0.76
Micro_Draft4_Properties_Triad_Closed	164.28957058881915 ns/iter	189.8079762291384 ns/iter	0.87
Micro_Draft4_Properties_Triad_Required	199.58316214646436 ns/iter	221.39823024482482 ns/iter	0.90
Micro_Draft4_Properties_Closed	35.700006234211614 ns/iter	51.329695899994476 ns/iter	0.70
Micro_Draft4_Non_Recursive_Ref	11.846655737663609 ns/iter	17.4697313219319 ns/iter	0.68
Micro_Draft4_Pattern_Properties_True	129.396349877937 ns/iter	172.5378402896463 ns/iter	0.75
Micro_Draft4_Ref_To_Single_Property	6.627024003082168 ns/iter	9.235925541739212 ns/iter	0.72
Micro_Draft4_Additional_Properties_Type	25.260711653226053 ns/iter	29.893029098313477 ns/iter	0.85
Micro_Draft4_Nested_Oneof	38.185337986756664 ns/iter	45.57661597914444 ns/iter	0.84
Micro_Draft4_Short_Enum	4.666736929526527 ns/iter	5.590820830000211 ns/iter	0.83
Micro_Draft4_Long_Enum	9.45528914916843 ns/iter	11.030230345841558 ns/iter	0.86
Micro_Draft4_Long_Enum_Short_Strings	6.3859633750742 ns/iter	6.491353032540935 ns/iter	0.98
Micro_Draft4_Type_Object	2.4653879958011617 ns/iter	2.536437615852698 ns/iter	0.97
Micro_Draft4_Ref_Single_100	1740111.0159816402 ns/iter	1880298.501577536 ns/iter	0.93
Micro_Draft4_Compile_Ref_Many_Nested	1161637.4649572838 ns/iter	1326373.2984015595 ns/iter	0.88
Micro_Draft4_Compile_Wrap	1974288.1464794728 ns/iter	2125545.7413250264 ns/iter	0.93
Micro_Draft6_Property_Names	93.99839012251222 ns/iter	109.89537988944628 ns/iter	0.86
Micro_Draft6_Compile_FHIR	7520972457.99996 ns/iter	11642602375.000025 ns/iter	0.65
Micro_Draft7_If_Then_Else	18.467701563822178 ns/iter	19.957482148872455 ns/iter	0.93
Micro_2019_09_Unevaluated_Properties	25.96744428127222 ns/iter	26.565599522392564 ns/iter	0.98
Micro_2019_09_Compile_Wrap	276678978.9999393 ns/iter	315599333.5000176 ns/iter	0.88
Micro_2019_09_KrakenD_Linter_Check	533461292.0000836 ns/iter	654596792.0001203 ns/iter	0.81
Micro_2019_09_KrakenD_Linter_Apply	5678442542.000084 ns/iter	5989632749.000066 ns/iter	0.95
Micro_2020_12_Dynamic_Ref	180.3651438417765 ns/iter	189.4574701877815 ns/iter	0.95
Micro_2020_12_Dynamic_Ref_Single	2.159694414115442 ns/iter	2.540782958719057 ns/iter	0.85
Micro_2020_12_Simple_Output_Mask	59011.242478793196 ns/iter	69493.064421096 ns/iter	0.85
Micro_2020_12_Simple_Output_Annotations	81575.50386194566 ns/iter	85154.41301490534 ns/iter	0.96
Micro_2020_12_Compile_NonCircular_Shared_Refs	767361.34680851 ns/iter	810012.5800225962 ns/iter	0.95
Micro_2020_12_Exhaustive_Deep_Numeric	4987.73544310445 ns/iter	5441.054029265912 ns/iter	0.92
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	107747.38300494399 ns/iter	117903.88647143696 ns/iter	0.91
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	13584.11132037138 ns/iter	14735.763839967916 ns/iter	0.92
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	89.36683442791286 ns/iter	93.24049955985052 ns/iter	0.96
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4490.93186252781 ns/iter	4847.839186806509 ns/iter	0.93

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: e5b64c9	Previous: 7558ff3	Ratio
E2E_Evaluator_adaptivecard	98637 ns	90272 ns	1.09
E2E_Evaluator_ansible-meta	838828 ns	801743 ns	1.05
E2E_Evaluator_aws-cdk	200241 ns	176343 ns	1.14
E2E_Evaluator_babelrc	363837 ns	370176 ns	0.98
E2E_Evaluator_cerebrum-criminal-case	3518054 ns	4575723 ns	0.77
E2E_Evaluator_clang-format	132464 ns	143785 ns	0.92
E2E_Evaluator_cmake-presets	14568130 ns	13847038 ns	1.05
E2E_Evaluator_code-climate	725447 ns	716008 ns	1.01
E2E_Evaluator_cql2	980028 ns	882853 ns	1.11
E2E_Evaluator_cspell	1534404 ns	1419282 ns	1.08
E2E_Evaluator_cypress	494468 ns	482822 ns	1.02
E2E_Evaluator_deno	822843 ns	835916 ns	0.98
E2E_Evaluator_dependabot	1522640 ns	1275962 ns	1.19
E2E_Evaluator_draft-04	19430120 ns	16988618 ns	1.14
E2E_Evaluator_fabric-mod	2611367 ns	2317457 ns	1.13
E2E_Evaluator_geojson	57609456 ns	57489174 ns	1.00
E2E_Evaluator_gitpod-configuration	762240 ns	667409 ns	1.14
E2E_Evaluator_helm-chart-lock	1487845 ns	1315152 ns	1.13
E2E_Evaluator_importmap	347551 ns	311943 ns	1.11
E2E_Evaluator_jasmine	442368 ns	413533 ns	1.07
E2E_Evaluator_jsconfig	1076124 ns	1139031 ns	0.94
E2E_Evaluator_jshintrc	1656809 ns	1703826 ns	0.97
E2E_Evaluator_krakend	510486 ns	486069 ns	1.05
E2E_Evaluator_lazygit	398784 ns	450097 ns	0.89
E2E_Evaluator_lerna	510686 ns	541548 ns	0.94
E2E_Evaluator_nest-cli	698361 ns	645862 ns	1.08
E2E_Evaluator_omc	79449 ns	77819 ns	1.02
E2E_Evaluator_omnisharp	995683 ns	982319 ns	1.01
E2E_Evaluator_openapi	28206755 ns	31047532 ns	0.91
E2E_Evaluator_pre-commit-hooks	1411067 ns	1278661 ns	1.10
E2E_Evaluator_pulumi	2349985 ns	2328447 ns	1.01
E2E_Evaluator_semantic-release	437170 ns	377484 ns	1.16
E2E_Evaluator_stale	517653 ns	521768 ns	0.99
E2E_Evaluator_stylecop	866331 ns	723155 ns	1.20
E2E_Evaluator_tmuxinator	325744 ns	293040 ns	1.11
E2E_Evaluator_ui5	1890907 ns	1813138 ns	1.04
E2E_Evaluator_ui5-manifest	7940928 ns	8324211 ns	0.95
E2E_Evaluator_unreal-engine-uproject	1448029 ns	1766698 ns	0.82
E2E_Evaluator_vercel	911240 ns	897879 ns	1.01
E2E_Evaluator_yamllint	84618 ns	53420 ns	1.58

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: e5b64c9	Previous: 7558ff3	Ratio
Micro_2020_12_Dynamic_Ref	261.41491472202 ns/iter	261.3056930666387 ns/iter	1.00
Micro_2020_12_Dynamic_Ref_Single	4.979617072304725 ns/iter	4.982487189292559 ns/iter	1.00
Micro_2020_12_Simple_Output_Mask	73944.00311693878 ns/iter	74235.44405445266 ns/iter	1.00
Micro_2020_12_Simple_Output_Annotations	112304.82425135249 ns/iter	113351.89962399034 ns/iter	0.99
Micro_2020_12_Compile_NonCircular_Shared_Refs	1210349.8206895753 ns/iter	1210736.410344821 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric	8514.570707873041 ns/iter	8429.686653270759 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	167799.3465991185 ns/iter	168329.67561519705 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	25235.419230206935 ns/iter	25280.60765739744 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	130.80185903716378 ns/iter	128.3842572844004 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	4703.518773533643 ns/iter	4776.1521494789495 ns/iter	0.98
Micro_2019_09_Unevaluated_Properties	29.242623790237268 ns/iter	29.927955243983586 ns/iter	0.98
Micro_2019_09_Compile_Wrap	300996006.9999806 ns/iter	321280851.9999726 ns/iter	0.94
Micro_2019_09_KrakenD_Linter_Check	1262575136.9999988 ns/iter	1264189831.9999428 ns/iter	1.00
Micro_2019_09_KrakenD_Linter_Apply	11155355626.000072 ns/iter	11382282074.000046 ns/iter	0.98
Micro_Draft7_If_Then_Else	24.503030430571247 ns/iter	24.26200529810013 ns/iter	1.01
Micro_Draft6_Property_Names	148.83564867702012 ns/iter	149.20569040909334 ns/iter	1.00
Micro_Draft6_Compile_FHIR	14213043465.000055 ns/iter	14475535923.999928 ns/iter	0.98
Micro_Draft4_Meta_1_No_Callback	166.8654063118836 ns/iter	166.74288773228412 ns/iter	1.00
Micro_Draft4_Required_Properties	850.136390626929 ns/iter	848.8584467622487 ns/iter	1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match	20.89569766348174 ns/iter	20.89149194739884 ns/iter	1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match	13.08839056905414 ns/iter	13.127434645718726 ns/iter	1.00
Micro_Draft4_Items_Schema	334.6061296217009 ns/iter	352.5060350489322 ns/iter	0.95
Micro_Draft4_Nested_Object	1.871422760356353 ns/iter	1.874742402045458 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	399.075772203473 ns/iter	419.8399793328916 ns/iter	0.95
Micro_Draft4_Properties_Triad_Closed	324.24149283812636 ns/iter	329.63889760789016 ns/iter	0.98
Micro_Draft4_Properties_Triad_Required	415.3742073441494 ns/iter	450.4012923814497 ns/iter	0.92
Micro_Draft4_Properties_Closed	64.41493662336921 ns/iter	64.37222875535367 ns/iter	1.00
Micro_Draft4_Non_Recursive_Ref	10.00564097040002 ns/iter	9.9624174926469 ns/iter	1.00
Micro_Draft4_Pattern_Properties_True	227.7272918993846 ns/iter	227.62071755487088 ns/iter	1.00
Micro_Draft4_Ref_To_Single_Property	13.106213022018048 ns/iter	13.084468690548823 ns/iter	1.00
Micro_Draft4_Additional_Properties_Type	14.70099038722768 ns/iter	14.62983106089429 ns/iter	1.00
Micro_Draft4_Nested_Oneof	67.0113309508182 ns/iter	66.3169587696495 ns/iter	1.01
Micro_Draft4_Short_Enum	14.689792028444353 ns/iter	14.693500652223282 ns/iter	1.00
Micro_Draft4_Long_Enum	15.03035518612293 ns/iter	14.729225420876986 ns/iter	1.02
Micro_Draft4_Long_Enum_Short_Strings	14.614982049812431 ns/iter	14.711030155322147 ns/iter	0.99
Micro_Draft4_Type_Object	4.666312166836431 ns/iter	4.672145850439748 ns/iter	1.00
Micro_Draft4_Ref_Single_100	2517337.2230215166 ns/iter	2525098.622302037 ns/iter	1.00
Micro_Draft4_Compile_Ref_Many_Nested	1828681.5647668992 ns/iter	1831075.1044387447 ns/iter	1.00
Micro_Draft4_Compile_Wrap	2628949.297397858 ns/iter	2605584.8619403522 ns/iter	1.01
E2E_Compiler_adaptivecard	64893360.545459636 ns/iter	66816785.59999682 ns/iter	0.97
E2E_Compiler_ansible_meta	30584708.26087377 ns/iter	30527788.652173754 ns/iter	1.00
E2E_Compiler_aws_cdk	414320.957131084 ns/iter	417176.1866428104 ns/iter	0.99
E2E_Compiler_babelrc	2784960.501976151 ns/iter	2788142.522522239 ns/iter	1.00
E2E_Compiler_clang_format	19667163.47222233 ns/iter	19939058.722223356 ns/iter	0.99
E2E_Compiler_cmake_presets	27057615.92307436 ns/iter	27916504.04166527 ns/iter	0.97
E2E_Compiler_code_climate	2813970.1164660207 ns/iter	2844868.0120481546 ns/iter	0.99
E2E_Compiler_cql2	14076447.120000921 ns/iter	14116111.448979793 ns/iter	1.00
E2E_Compiler_cspell	25466368.758617952 ns/iter	24387758.965519484 ns/iter	1.04
E2E_Compiler_cypress	4227613.587878212 ns/iter	4149549.7261907067 ns/iter	1.02
E2E_Compiler_deno	8295770.53571435 ns/iter	8261698.811763969 ns/iter	1.00
E2E_Compiler_dependabot	4252180.28484792 ns/iter	4234484.963636863 ns/iter	1.00
E2E_Compiler_draft_04	3002896.382978624 ns/iter	2981942.62978744 ns/iter	1.01
E2E_Compiler_fabric_mod	5230682.7761197435 ns/iter	5188134.888888911 ns/iter	1.01
E2E_Compiler_geojson	24470511.89655416 ns/iter	24148598.758623347 ns/iter	1.01
E2E_Compiler_gitpod_configuration	5414135.78625924 ns/iter	5298994.553030387 ns/iter	1.02
E2E_Compiler_helm_chart_lock	763847.6651982223 ns/iter	764523.3191256583 ns/iter	1.00
E2E_Compiler_importmap	314036.55093648576 ns/iter	313688.4422990504 ns/iter	1.00
E2E_Compiler_jasmine	1513737.0961538064 ns/iter	1480169.9067795095 ns/iter	1.02
E2E_Compiler_jshintrc	4783902.1643837495 ns/iter	4705574.885906114 ns/iter	1.02
E2E_Compiler_jsconfig	23510088.799999572 ns/iter	23637882.333332527 ns/iter	0.99
E2E_Compiler_krakend	144576927.39999858 ns/iter	154690774.79999667 ns/iter	0.93
E2E_Compiler_lazygit	36101023.65000217 ns/iter	35984838.2999985 ns/iter	1.00
E2E_Compiler_lerna	1799100.092544895 ns/iter	1748965.1979952245 ns/iter	1.03
E2E_Compiler_nest_cli	8223626.435293387 ns/iter	8065460.678160147 ns/iter	1.02
E2E_Compiler_omc	168083781.25000444 ns/iter	172944214.5000064 ns/iter	0.97
E2E_Compiler_omnisharp	7378015.673469106 ns/iter	7252328.653060997 ns/iter	1.02
E2E_Compiler_openapi	27201964.92000014 ns/iter	27251549.27999938 ns/iter	1.00
E2E_Compiler_pre_commit_hooks	5804015.0330573525 ns/iter	5726507.721311597 ns/iter	1.01
E2E_Compiler_pulumi	4430919.431249691 ns/iter	4409301.6918234145 ns/iter	1.00
E2E_Compiler_semantic_release	1722128.1941031944 ns/iter	1725425.122850165 ns/iter	1.00
E2E_Compiler_stale	1688421.786925089 ns/iter	1687527.1947114356 ns/iter	1.00
E2E_Compiler_stylecop	6433079.155963534 ns/iter	6385803.064219561 ns/iter	1.01
E2E_Compiler_tmuxinator	2128692.5927050267 ns/iter	2106854.3012046963 ns/iter	1.01
E2E_Compiler_ui5	49080993.14285762 ns/iter	50581932.357139125 ns/iter	0.97
E2E_Compiler_ui5_manifest	328481873.0000438 ns/iter	334295992.9999552 ns/iter	0.98
E2E_Compiler_unreal_engine_uproject	4964596.141843982 ns/iter	4955923.697183076 ns/iter	1.00
E2E_Compiler_vercel	13213950.867924603 ns/iter	13354720.66037744 ns/iter	0.99
E2E_Compiler_yamllint	384657.4385964854 ns/iter	385331.33918772126 ns/iter	1.00
E2E_Evaluator_adaptivecard	24249.117182335354 ns/iter	24780.437329984685 ns/iter	0.98
E2E_Evaluator_ansible_meta	260446.25363372455 ns/iter	255048.372570188 ns/iter	1.02
E2E_Evaluator_aws_cdk	53018.49934008588 ns/iter	52044.29387393009 ns/iter	1.02
E2E_Evaluator_babelrc	110438.31220582644 ns/iter	109593.96790005825 ns/iter	1.01
E2E_Evaluator_cerebrum_criminal_case	1286929.1060605785 ns/iter	1306133.0169809377 ns/iter	0.99
E2E_Evaluator_clang_format	109995.06723084066 ns/iter	112392.87170947104 ns/iter	0.98
E2E_Evaluator_cmake_presets	4465610.331250502 ns/iter	5687853.270000005 ns/iter	0.79
E2E_Evaluator_code_climate	190304.1538069514 ns/iter	189658.61321512988 ns/iter	1.00
E2E_Evaluator_cql2	218297.37612963165 ns/iter	224396.0359529221 ns/iter	0.97
E2E_Evaluator_cspell	551272.2376470622 ns/iter	556885.9125595691 ns/iter	0.99
E2E_Evaluator_cypress	184739.81651855807 ns/iter	182910.6449332253 ns/iter	1.01
E2E_Evaluator_deno	335796.52396931226 ns/iter	336914.5974211895 ns/iter	1.00
E2E_Evaluator_dependabot	476940.37888196495 ns/iter	470833.9750674094 ns/iter	1.01
E2E_Evaluator_draft_04	6809820.910890752 ns/iter	7576912.180850479 ns/iter	0.90
E2E_Evaluator_fabric_mod	755414.0483871037 ns/iter	767493.4197397219 ns/iter	0.98
E2E_Evaluator_geojson	17788616.904762678 ns/iter	16128538.636365874 ns/iter	1.10
E2E_Evaluator_gitpod_configuration	258134.43898752003 ns/iter	254769.08513709318 ns/iter	1.01
E2E_Evaluator_helm_chart_lock	335059.51500934816 ns/iter	328742.21576764685 ns/iter	1.02
E2E_Evaluator_importmap	49540.76878069375 ns/iter	48442.87941501717 ns/iter	1.02
E2E_Evaluator_jasmine	118009.42078623163 ns/iter	116015.24400331434 ns/iter	1.02
E2E_Evaluator_jshintrc	1067155.0928463018 ns/iter	1054650.2364458872 ns/iter	1.01
E2E_Evaluator_jsconfig	406424.9148061024 ns/iter	409372.3257176334 ns/iter	0.99
E2E_Evaluator_krakend	216479.1027292102 ns/iter	212462.9828693776 ns/iter	1.02
E2E_Evaluator_lazygit	139004.62075970083 ns/iter	141378.77551021366 ns/iter	0.98
E2E_Evaluator_lerna	156207.04647506998 ns/iter	156193.3766349065 ns/iter	1.00
E2E_Evaluator_nest_cli	197259.84421112327 ns/iter	197172.962312284 ns/iter	1.00
E2E_Evaluator_omc	19343.830951852 ns/iter	19021.05200821036 ns/iter	1.02
E2E_Evaluator_omnisharp	571670.8432475331 ns/iter	563825.488871205 ns/iter	1.01
E2E_Evaluator_openapi	12162411.054545043 ns/iter	13811741.019999318 ns/iter	0.88
E2E_Evaluator_pre_commit_hooks	527812.1097016517 ns/iter	512503.7570579455 ns/iter	1.03
E2E_Evaluator_pulumi	741576.2297873795 ns/iter	730818.9106029175 ns/iter	1.01
E2E_Evaluator_semantic_release	105043.38363850166 ns/iter	104805.07803806035 ns/iter	1.00
E2E_Evaluator_stale	169472.48844966898 ns/iter	168532.00900049703 ns/iter	1.01
E2E_Evaluator_stylecop	314574.4899328619 ns/iter	306019.03343465476 ns/iter	1.03
E2E_Evaluator_tmuxinator	101496.12905083054 ns/iter	98217.95416550567 ns/iter	1.03
E2E_Evaluator_ui5	549791.1417444462 ns/iter	548831.7756508483 ns/iter	1.00
E2E_Evaluator_ui5_manifest	2851892.8915662356 ns/iter	2848439.3714284217 ns/iter	1.00
E2E_Evaluator_unreal_engine_uproject	489320.0510894388 ns/iter	476021.87669372885 ns/iter	1.03
E2E_Evaluator_vercel	325249.08780941647 ns/iter	316974.37023596663 ns/iter	1.03
E2E_Evaluator_yamllint	11110.132228017561 ns/iter	10775.227729100983 ns/iter	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: e5b64c9	Previous: 7558ff3	Ratio
E2E_Evaluator_adaptivecard	136206 ns	113826 ns	1.20
E2E_Evaluator_ansible-meta	1203862 ns	966435 ns	1.25
E2E_Evaluator_aws-cdk	262158 ns	213215 ns	1.23
E2E_Evaluator_babelrc	542861 ns	406562 ns	1.34
E2E_Evaluator_cerebrum-criminal-case	5493567 ns	4273098 ns	1.29
E2E_Evaluator_clang-format	197286 ns	160439 ns	1.23
E2E_Evaluator_cmake-presets	20939648 ns	16634369 ns	1.26
E2E_Evaluator_code-climate	1002818 ns	848465 ns	1.18
E2E_Evaluator_cql2	1351645 ns	1099120 ns	1.23
E2E_Evaluator_cspell	2352657 ns	1771378 ns	1.33
E2E_Evaluator_cypress	646184 ns	520335 ns	1.24
E2E_Evaluator_deno	1230528 ns	998327 ns	1.23
E2E_Evaluator_dependabot	1942563 ns	1510582 ns	1.29
E2E_Evaluator_draft-04	24589756 ns	19780289 ns	1.24
E2E_Evaluator_fabric-mod	3804142 ns	3038410 ns	1.25
E2E_Evaluator_geojson	74931001 ns	53693813 ns	1.40
E2E_Evaluator_gitpod-configuration	1230383 ns	921752 ns	1.33
E2E_Evaluator_helm-chart-lock	1850908 ns	1427811 ns	1.30
E2E_Evaluator_importmap	550155 ns	405008 ns	1.36
E2E_Evaluator_jasmine	666821 ns	467110 ns	1.43
E2E_Evaluator_jsconfig	1920392 ns	1340236 ns	1.43
E2E_Evaluator_jshintrc	2163657 ns	1848040 ns	1.17
E2E_Evaluator_krakend	817605 ns	696279 ns	1.17
E2E_Evaluator_lazygit	625289 ns	483734 ns	1.29
E2E_Evaluator_lerna	683076 ns	518324 ns	1.32
E2E_Evaluator_nest-cli	1108257 ns	830725 ns	1.33
E2E_Evaluator_omc	118858 ns	85125 ns	1.40
E2E_Evaluator_omnisharp	1432875 ns	1158913 ns	1.24
E2E_Evaluator_openapi	45577568 ns	42835750 ns	1.06
E2E_Evaluator_pre-commit-hooks	1905694 ns	1491185 ns	1.28
E2E_Evaluator_pulumi	3432191 ns	2661980 ns	1.29
E2E_Evaluator_semantic-release	645935 ns	474149 ns	1.36
E2E_Evaluator_stale	758359 ns	561025 ns	1.35
E2E_Evaluator_stylecop	1307759 ns	990278 ns	1.32
E2E_Evaluator_tmuxinator	483347 ns	382251 ns	1.26
E2E_Evaluator_ui5	2950186 ns	2271688 ns	1.30
E2E_Evaluator_ui5-manifest	11895464 ns	11406836 ns	1.04
E2E_Evaluator_unreal-engine-uproject	1985546 ns	1615134 ns	1.23
E2E_Evaluator_vercel	1355096 ns	1124788 ns	1.20
E2E_Evaluator_yamllint	143090 ns	71087 ns	2.01

This comment was automatically generated by workflow using github-action-benchmark.

[cubic-dev-ai]

No issues found across 4 files

[augmentcode]

🤖 Augment PR Summary

Summary: This PR adds evaluator callback (trace) support to the JavaScript port of Blaze.

Changes:

• Extends Blaze.validate() to accept an optional callback and tracks both schema evaluation path and instance location.
• Adds JSON Pointer construction utilities and callback-aware instruction dispatchers (fast vs tracked).
• Emits pre/post callback events from most evaluator instructions, including annotation reporting.
• Updates CI to run JS tests via npm test and expands the JS test script to include the new trace runner.
• Adds ports/javascript/trace.mjs to run the upstream evaluator trace suites against the JS port using the compile CLI.

Technical Notes: Callback mode is enabled when a second argument is passed to validate(), and the callback receives instruction metadata plus evaluatePath/instanceLocation pointers.

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. 1 suggestion posted.

Comment augment review to trigger a new review at any time.

[augmentcode]

ports/javascript/index.mjs:231 — this.callbackMode = callback !== undefined enables callback mode for non-function values like null, which will later throw when this.callback(...) is invoked. Consider guarding on the callback being callable (or explicitly treating null as “no callback”).

Severity: medium

_{🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.}

[augmentcode]

Review completed. 1 suggestion posted.

Comment augment review to trigger a new review at any time.

[augmentcode]

ports/javascript/index.mjs:1921
In LoopKeys, child instructions are evaluated with instance=null (see the evaluateInstruction(children[childIndex], null, ...) call a few lines below), relying on evaluator.propertyTarget as an implicit value source. This can change propertyNames semantics for any child opcode that still uses resolveInstance(instance, ...) directly (e.g., AssertionType* / LogicalWhenType), potentially letting schemas like propertyNames: { type: "null" } validate non-empty objects because the evaluated instance becomes null instead of the property name string.

Severity: high

_{🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.}

[augmentcode]

Review completed. 1 suggestion posted.

Comment augment review to trigger a new review at any time.

[augmentcode]

ports/javascript/index.mjs:275 � Cleanup of callback-related state only happens on the normal return path; if evaluation throws (including from a user-provided callback), fields like callbackMode/token arrays and the selected evaluateInstruction function won�t be reset. That can leave the evaluator in a partially-initialized state after an exception and affect subsequent validations.

Severity: medium

_{🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.}