Skip to content

Supporting testing RDF expansions - #957

Merged
jviotti merged 3 commits into
mainfrom
test-rdf
Aug 3, 2026
Merged

Supporting testing RDF expansions#957
jviotti merged 3 commits into
mainfrom
test-rdf

Conversation

@jviotti

@jviotti jviotti commented Aug 3, 2026

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Review in cubic

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Comment thread src/test/include/sourcemeta/blaze/test.h Outdated
Comment thread src/test/include/sourcemeta/blaze/test_error.h Outdated
Comment thread test/test/test_run_test.cc Outdated
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti jviotti changed the title [WIP] Supporting testing RDF expansions Supporting testing RDF expansions Aug 3, 2026
@jviotti
jviotti marked this pull request as ready for review August 3, 2026 18:34

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: b503eaf Previous: 6ea1ec2 Ratio
Schema_Iterator_ISO_Language 2012446.7671641824 ns/iter 1941461.9378377777 ns/iter 1.04
Schema_Tracker_ISO_Language 3333214.2857142612 ns/iter 3143297.139830546 ns/iter 1.06
Schema_Tracker_ISO_Language_To_JSON 17026644.857145086 ns/iter 16606637.904761186 ns/iter 1.03
Schema_Frame_WoT_References 5561709.999999493 ns/iter 5095311.554838454 ns/iter 1.09
Schema_Frame_OMC_References 33434069.416666526 ns/iter 24261224.48387178 ns/iter 1.38
Schema_Frame_OMC_Locations 25408892.85714343 ns/iter 22151713.531251006 ns/iter 1.15
Schema_Frame_ISO_Language_Locations 85528782.44444805 ns/iter 78625175.88889912 ns/iter 1.09
Schema_Frame_KrakenD_References 42721561.23529251 ns/iter 43255314.83333281 ns/iter 0.99
Schema_Frame_KrakenD_Reachable 426455542.00004196 ns/iter 442147500.0000328 ns/iter 0.96
Schema_Frame_ISO_Language_Locations_To_JSON 93226838.50000146 ns/iter 75616432.37499993 ns/iter 1.23
Schema_Frame_Many_Resources_References 314158853.99997026 ns/iter 274160041.6666946 ns/iter 1.15
Schema_Bundle_Meta_2020_12 1524099.160155723 ns/iter 1346266.7304384012 ns/iter 1.13
Schema_Format_ISO_Language_To_JSON 85545023.57141505 ns/iter 101413114.62503211 ns/iter 0.84
E2E_Compiler_adaptivecard 62796890.09090816 ns/iter 56132654.20000744 ns/iter 1.12
E2E_Compiler_ansible_meta 25728742.29629515 ns/iter 21560995.967741936 ns/iter 1.19
E2E_Compiler_aws_cdk 333364.0772569504 ns/iter 245198.85769098526 ns/iter 1.36
E2E_Compiler_babelrc 2372114.361702133 ns/iter 1868944.2579787576 ns/iter 1.27
E2E_Compiler_clang_format 15790030.55555606 ns/iter 13605781.250001533 ns/iter 1.16
E2E_Compiler_cmake_presets 30466907.407407638 ns/iter 21348406.57575668 ns/iter 1.43
E2E_Compiler_code_climate 2272980.6743424623 ns/iter 2017862.8169398874 ns/iter 1.13
E2E_Compiler_cql2 11852687.500000533 ns/iter 9990360.444445532 ns/iter 1.19
E2E_Compiler_cspell 20970014.70588111 ns/iter 17828943.358976036 ns/iter 1.18
E2E_Compiler_cypress 3736239.0555556132 ns/iter 3090070.2995595685 ns/iter 1.21
E2E_Compiler_deno 7605573.39449531 ns/iter 5798117.082644585 ns/iter 1.31
E2E_Compiler_dependabot 3676142.2780489563 ns/iter 3419069.747826103 ns/iter 1.08
E2E_Compiler_draft_04 2482092.976261063 ns/iter 1801449.4421593735 ns/iter 1.38
E2E_Compiler_fabric_mod 4546028.09714288 ns/iter 3240215.277777999 ns/iter 1.40
E2E_Compiler_geojson 26762084.758619778 ns/iter 19061368.750001863 ns/iter 1.40
E2E_Compiler_gitpod_configuration 5287980.419999485 ns/iter 3541835.858586086 ns/iter 1.49
E2E_Compiler_helm_chart_lock 556724.6291498435 ns/iter 456442.5829537823 ns/iter 1.22
E2E_Compiler_importmap 219994.68801716628 ns/iter 197373.7437185992 ns/iter 1.11
E2E_Compiler_jasmine 1129378.6732522817 ns/iter 915458.8276315603 ns/iter 1.23
E2E_Compiler_jshintrc 3712001.019512283 ns/iter 2938105.4769878974 ns/iter 1.26
E2E_Compiler_jsconfig 21256922.794119712 ns/iter 16306365.302324234 ns/iter 1.30
E2E_Compiler_krakend 139602166.6000024 ns/iter 110774777.83334188 ns/iter 1.26
E2E_Compiler_lazygit 37051686.42105299 ns/iter 31112695.00000162 ns/iter 1.19
E2E_Compiler_lerna 1378835.282978924 ns/iter 1129498.1116504273 ns/iter 1.22
E2E_Compiler_nest_cli 7238359.540322439 ns/iter 5504114.826771553 ns/iter 1.32
E2E_Compiler_omc 186541395.74999818 ns/iter 136475183.39998895 ns/iter 1.37
E2E_Compiler_omnisharp 6239400.294643157 ns/iter 5297565.125926196 ns/iter 1.18
E2E_Compiler_openapi 23346027.800001442 ns/iter 19549941.17647188 ns/iter 1.19
E2E_Compiler_pre_commit_hooks 4230403.5493823085 ns/iter 3813754.55191253 ns/iter 1.11
E2E_Compiler_pulumi 3577990.0761900493 ns/iter 2970199.3905580454 ns/iter 1.20
E2E_Compiler_semantic_release 1325214.2857142806 ns/iter 1058971.8634294863 ns/iter 1.25
E2E_Compiler_stale 1309700.0732143116 ns/iter 1135685.8919753078 ns/iter 1.15
E2E_Compiler_stylecop 5445066.2677165 ns/iter 4532723.509934286 ns/iter 1.20
E2E_Compiler_tmuxinator 1594536.435065042 ns/iter 1329587.7110693334 ns/iter 1.20
E2E_Compiler_ui5 56221262.8461531 ns/iter 48539349.307693906 ns/iter 1.16
E2E_Compiler_ui5_manifest 348822041.99999475 ns/iter 266508583.000018 ns/iter 1.31
E2E_Compiler_unreal_engine_uproject 3871100.943299388 ns/iter 3281517.605633896 ns/iter 1.18
E2E_Compiler_users_array 756697.1025390057 ns/iter 621060.5332167948 ns/iter 1.22
E2E_Compiler_vercel 11214177.904763447 ns/iter 9870170.774648538 ns/iter 1.14
E2E_Compiler_yamllint 257397.86505939 ns/iter 227078.7383570676 ns/iter 1.13
E2E_Evaluator_adaptivecard 20378.220372573203 ns/iter 18291.611039666983 ns/iter 1.11
E2E_Evaluator_ansible_meta 177606.03876166226 ns/iter 156231.41247215142 ns/iter 1.14
E2E_Evaluator_aws_cdk 40783.22647715094 ns/iter 34087.54277726865 ns/iter 1.20
E2E_Evaluator_babelrc 90578.31094615614 ns/iter 83684.37224426685 ns/iter 1.08
E2E_Evaluator_cerebrum_criminal_case 837413.8059701892 ns/iter 728816.2649006855 ns/iter 1.15
E2E_Evaluator_clang_format 107271.86270222726 ns/iter 103688.54700264013 ns/iter 1.03
E2E_Evaluator_cmake_presets 3845559.840425615 ns/iter 3104582.376146557 ns/iter 1.24
E2E_Evaluator_code_climate 160689.65867533226 ns/iter 120852.23687820889 ns/iter 1.33
E2E_Evaluator_cql2 165011.2589995466 ns/iter 139257.23492001687 ns/iter 1.18
E2E_Evaluator_cspell 455973.32828950393 ns/iter 393721.68353010225 ns/iter 1.16
E2E_Evaluator_cypress 149869.14001658538 ns/iter 131365.13045988677 ns/iter 1.14
E2E_Evaluator_deno 282091.21042759955 ns/iter 268098.23698022525 ns/iter 1.05
E2E_Evaluator_dependabot 260929.59090907575 ns/iter 226180.95189223348 ns/iter 1.15
E2E_Evaluator_draft_04 5673839.381679569 ns/iter 4734721.653061551 ns/iter 1.20
E2E_Evaluator_fabric_mod 571348.7909999914 ns/iter 437493.14752042625 ns/iter 1.31
E2E_Evaluator_geojson 9596959.507042568 ns/iter 8214357.7317075 ns/iter 1.17
E2E_Evaluator_gitpod_configuration 183648.67194393056 ns/iter 159758.56299841075 ns/iter 1.15
E2E_Evaluator_helm_chart_lock 252768.52594887346 ns/iter 220024.22704401324 ns/iter 1.15
E2E_Evaluator_importmap 40489.794440133875 ns/iter 33148.233605395246 ns/iter 1.22
E2E_Evaluator_jasmine 98535.39271366989 ns/iter 79138.72339459225 ns/iter 1.25
E2E_Evaluator_jshintrc 1175775.6630727407 ns/iter 965970.5179678764 ns/iter 1.22
E2E_Evaluator_jsconfig 324302.8961499342 ns/iter 280191.4831999966 ns/iter 1.16
E2E_Evaluator_krakend 146092.94805464233 ns/iter 123131.92988018405 ns/iter 1.19
E2E_Evaluator_lazygit 96486.6257779012 ns/iter 95194.32252876394 ns/iter 1.01
E2E_Evaluator_lerna 128007.79200666945 ns/iter 126946.73442906982 ns/iter 1.01
E2E_Evaluator_nest_cli 139980.63664718418 ns/iter 151653.556844102 ns/iter 0.92
E2E_Evaluator_omc 15606.664989984396 ns/iter 14948.290644255416 ns/iter 1.04
E2E_Evaluator_omnisharp 520392.70800003124 ns/iter 417511.78535667545 ns/iter 1.25
E2E_Evaluator_openapi 8980452.786666622 ns/iter 6790413.39215665 ns/iter 1.32
E2E_Evaluator_pre_commit_hooks 378301.2360446573 ns/iter 341187.61457383266 ns/iter 1.11
E2E_Evaluator_pulumi 645687.6234204506 ns/iter 476670.5921595823 ns/iter 1.35
E2E_Evaluator_semantic_release 78977.02852770555 ns/iter 65373.94064311725 ns/iter 1.21
E2E_Evaluator_stale 140581.818825715 ns/iter 109976.64921055126 ns/iter 1.28
E2E_Evaluator_stylecop 224063.34782610193 ns/iter 177970.96015229603 ns/iter 1.26
E2E_Evaluator_tmuxinator 77282.541395751 ns/iter 63666.36271949078 ns/iter 1.21
E2E_Evaluator_ui5 519576.28676467756 ns/iter 334300.07270858093 ns/iter 1.55
E2E_Evaluator_ui5_manifest 3209098.2289155107 ns/iter 1438968.6192467995 ns/iter 2.23
E2E_Evaluator_unreal_engine_uproject 551943.1453924791 ns/iter 311386.13315573265 ns/iter 1.77
E2E_Evaluator_users_array 715594.0102506457 ns/iter 433430.58858504804 ns/iter 1.65
E2E_Evaluator_vercel 313643.8788706678 ns/iter 212360.56985052538 ns/iter 1.48
E2E_Evaluator_yamllint 9836.187907578736 ns/iter 6009.793839618963 ns/iter 1.64
JSONLD_Catalog_Simple 27932956.15789535 ns/iter 17037827.243906043 ns/iter 1.64
JSONLD_Catalog_Override_Agreeing 41018833.31817775 ns/iter 17257001.024390552 ns/iter 2.38
JSONLD_Catalog_Override_Shadowing 53342467.2857125 ns/iter 24546493.290325735 ns/iter 2.17
Micro_Draft4_Meta_1_No_Callback 228.83930266126376 ns/iter 128.38493998447385 ns/iter 1.78
Micro_Draft4_Required_Properties 992.4163320609943 ns/iter 661.7156372419281 ns/iter 1.50
Micro_Draft4_Many_Optional_Properties_Minimal_Match 26.230629817411764 ns/iter 15.199389012717255 ns/iter 1.73
Micro_Draft4_Few_Optional_Properties_Minimal_Match 14.922005355748004 ns/iter 7.405143032998399 ns/iter 2.02
Micro_Draft4_Items_Schema 399.59716185569243 ns/iter 197.6193661125691 ns/iter 2.02
Micro_Draft4_Nested_Object 1.5377551513745153 ns/iter 0.9508135611942461 ns/iter 1.62
Micro_Draft4_Properties_Triad_Optional 339.58535714248757 ns/iter 199.88736036577566 ns/iter 1.70
Micro_Draft4_Properties_Triad_Closed 228.14061379618784 ns/iter 160.34502279208783 ns/iter 1.42
Micro_Draft4_Properties_Triad_Required 275.9980096069271 ns/iter 207.3559889137181 ns/iter 1.33
Micro_Draft4_Properties_Closed 51.378809266496205 ns/iter 38.838175109855364 ns/iter 1.32
Micro_Draft4_Non_Recursive_Ref 14.75317492102534 ns/iter 11.667822491614384 ns/iter 1.26
Micro_Draft4_Pattern_Properties_True 172.7351307465454 ns/iter 135.19825981049257 ns/iter 1.28
Micro_Draft4_Ref_To_Single_Property 10.43875898023695 ns/iter 7.482307117502444 ns/iter 1.40
Micro_Draft4_Additional_Properties_Type 37.11148821464696 ns/iter 25.556015671218983 ns/iter 1.45
Micro_Draft4_Nested_Oneof 53.503926255146894 ns/iter 33.110820933007375 ns/iter 1.62
Micro_Draft4_Short_Enum 6.740789385093628 ns/iter 4.612494138740055 ns/iter 1.46
Micro_Draft4_Long_Enum 13.830308885128325 ns/iter 8.814079581546295 ns/iter 1.57
Micro_Draft4_Long_Enum_Short_Strings 10.3076153811354 ns/iter 6.129701408767351 ns/iter 1.68
Micro_Draft4_Type_Object 3.8569918100667593 ns/iter 2.34494339144313 ns/iter 1.64
Micro_Draft4_Ref_Single_100 2440625.7761194776 ns/iter 1628598.9696966691 ns/iter 1.50
Micro_Draft4_Compile_Ref_Many_Nested 1564403.5087718824 ns/iter 1178117.1313629614 ns/iter 1.33
Micro_Draft4_Compile_Wrap 2419252.546762433 ns/iter 1805521.6907215514 ns/iter 1.34
Micro_Draft6_Property_Names 109.25407654568531 ns/iter 90.73386766957498 ns/iter 1.20
Micro_Draft6_Compile_FHIR 17650147542.00001 ns/iter 9420396707.999998 ns/iter 1.87
Micro_Draft7_If_Then_Else 18.651555501906618 ns/iter 15.380013034731972 ns/iter 1.21
Micro_2019_09_Unevaluated_Properties 26.664788122757034 ns/iter 25.09068296978251 ns/iter 1.06
Micro_2019_09_Compile_Wrap 451819895.49996614 ns/iter 276041958.3333563 ns/iter 1.64
Micro_2020_12_Dynamic_Ref 676.6200761019426 ns/iter 571.6557518875757 ns/iter 1.18
Micro_2020_12_Dynamic_Ref_Single 2.552232126377624 ns/iter 2.2529379663838203 ns/iter 1.13
Micro_2020_12_Simple_Output_Mask 891.3742367852402 ns/iter 765.7043623389171 ns/iter 1.16
Micro_2020_12_Simple_Output_Annotations 76281.97805897499 ns/iter 55696.33615931197 ns/iter 1.37
Micro_2020_12_Simple_Output_Annotation_Dropping 2171314.918495281 ns/iter 1409438.4589179116 ns/iter 1.54
Micro_2020_12_Compile_NonCircular_Shared_Refs 1298777.1304926157 ns/iter 778751.3034410923 ns/iter 1.67
Micro_2020_12_Exhaustive_Deep_Numeric 9374.34540301486 ns/iter 4748.860451216285 ns/iter 1.97
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 56350.640184520365 ns/iter 33678.68510977502 ns/iter 1.67
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 21642.15229000055 ns/iter 13462.786884273295 ns/iter 1.61
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 103.2402094900299 ns/iter 80.55718159889031 ns/iter 1.28
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4012.8032862376085 ns/iter 3030.8591938183145 ns/iter 1.32
Alterschema_Check_Readibility_ISO_Language_Set_3 259066062.49998277 ns/iter 227793291.6666335 ns/iter 1.14
Alterschema_Check_Readibility_OMC 85418041.66667235 ns/iter 55833829.833337255 ns/iter 1.53
Alterschema_Check_Readibility_KrakenD 1004765624.9998908 ns/iter 602766500.0001434 ns/iter 1.67
Alterschema_Apply_Readibility_KrakenD 90948139499.00003 ns/iter 70246244624.99992 ns/iter 1.29
Alterschema_Check_Invalid_External_Refs 194102569.66671112 ns/iter 184775937.4999782 ns/iter 1.05

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: b503eaf Previous: 6ea1ec2 Ratio
E2E_Evaluator_adaptivecard 158994 ns 105070 ns 1.51
E2E_Evaluator_ansible-meta 485489 ns 443531 ns 1.09
E2E_Evaluator_aws-cdk 148533 ns 123756 ns 1.20
E2E_Evaluator_babelrc 360639 ns 266983 ns 1.35
E2E_Evaluator_cerebrum-criminal-case 2276552 ns 1597226 ns 1.43
E2E_Evaluator_clang-format 234942 ns 163979 ns 1.43
E2E_Evaluator_cmake-presets 15002453 ns 11937542 ns 1.26
E2E_Evaluator_code-climate 445222 ns 362250 ns 1.23
E2E_Evaluator_cql2 1049525 ns 1147485 ns 0.91
E2E_Evaluator_cspell 1130594 ns 1325427 ns 0.85
E2E_Evaluator_cypress 599618 ns 579599 ns 1.03
E2E_Evaluator_deno 845411 ns 674817 ns 1.25
E2E_Evaluator_dependabot 830769 ns 746351 ns 1.11
E2E_Evaluator_draft-04 16621467 ns 15328746 ns 1.08
E2E_Evaluator_fabric-mod 1614267 ns 1370444 ns 1.18
E2E_Evaluator_geojson 17501272 ns 17593574 ns 0.99
E2E_Evaluator_gitpod-configuration 546688 ns 714813 ns 0.76
E2E_Evaluator_helm-chart-lock 894327 ns 988149 ns 0.91
E2E_Evaluator_importmap 222238 ns 248037 ns 0.90
E2E_Evaluator_jasmine 229310 ns 218847 ns 1.05
E2E_Evaluator_jsconfig 902605 ns 920522 ns 0.98
E2E_Evaluator_jshintrc 2241181 ns 1995527 ns 1.12
E2E_Evaluator_krakend 439037 ns 432683 ns 1.01
E2E_Evaluator_lazygit 293211 ns 327907 ns 0.89
E2E_Evaluator_lerna 362977 ns 345922 ns 1.05
E2E_Evaluator_nest-cli 471260 ns 444402 ns 1.06
E2E_Evaluator_omc 94779 ns 112303 ns 0.84
E2E_Evaluator_omnisharp 1028271 ns 1041063 ns 0.99
E2E_Evaluator_openapi 32380997 ns 28833692 ns 1.12
E2E_Evaluator_pre-commit-hooks 1823892 ns 1338886 ns 1.36
E2E_Evaluator_pulumi 1712034 ns 1539176 ns 1.11
E2E_Evaluator_semantic-release 234750 ns 208073 ns 1.13
E2E_Evaluator_stale 309443 ns 285540 ns 1.08
E2E_Evaluator_stylecop 736932 ns 713087 ns 1.03
E2E_Evaluator_tmuxinator 174928 ns 165621 ns 1.06
E2E_Evaluator_ui5 1541518 ns 1541517 ns 1.00
E2E_Evaluator_ui5-manifest 9211432 ns 8651206 ns 1.06
E2E_Evaluator_unreal-engine-uproject 1170569 ns 1181714 ns 0.99
E2E_Evaluator_users-array 1996402 ns 2646373 ns 0.75
E2E_Evaluator_vercel 829087 ns 752262 ns 1.10
E2E_Evaluator_yamllint 22111 ns 24145 ns 0.92

This comment was automatically generated by workflow using github-action-benchmark.

@augmentcode

augmentcode Bot commented Aug 3, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: This PR extends Blaze’s test runner so test cases can assert JSON-LD expanded-form output (“RDF promotion”) in addition to simple validity.

Changes:

  • Extend TestCase with an optional rdf expectation and add support for loading expectations from rdfPath (JSON/YAML).
  • Add TestOutcome (overall pass/fail, actual validity, produced expansion, and JSON-LD resolution error) and update TestSuite::Callback/run() to report it.
  • When any test expects RDF, automatically enable collection of JSON-LD annotation keywords during fast schema compilation via JSONLD_KEYWORDS.
  • Update the runner to call blaze::jsonld() for RDF-expected cases, while keeping plain validation for other cases.
  • Link the test target against the output component and add comprehensive unit tests + stubs covering inline/file expectations, multi-target suites, branching keywords, mismatch scenarios, and resolution errors.

Technical Notes: Promotion relies on blaze::jsonld(), which returns either expanded JSON-LD, validation errors (no RDF produced), or a resolution error when JSON-LD annotations conflict.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread src/test/test_parser.cc

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 12 files

Tip: cubic can generate docs of your entire codebase and keep them up to date. Try it here.

Re-trigger cubic

Comment thread test/test/test_suite_test.cc
Comment thread test/test/test_run_test.cc Outdated
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: b503eaf Previous: 6ea1ec2 Ratio
Schema_Iterator_ISO_Language 2878123.6875005336 ns/iter 2920110.945147319 ns/iter 0.99
Schema_Tracker_ISO_Language 4504916.708334071 ns/iter 4770011.621621653 ns/iter 0.94
Schema_Tracker_ISO_Language_To_JSON 20543107.294121698 ns/iter 21148752.181819543 ns/iter 0.97
Schema_Frame_WoT_References 4643080.07284798 ns/iter 4767224.635136122 ns/iter 0.97
Schema_Frame_OMC_References 19961396.828570545 ns/iter 23481520.966667328 ns/iter 0.85
Schema_Frame_OMC_Locations 18403897.76315844 ns/iter 20651597.62500457 ns/iter 0.89
Schema_Frame_ISO_Language_Locations 98660197.00003411 ns/iter 105848907.66665466 ns/iter 0.93
Schema_Frame_KrakenD_References 37695454.99999872 ns/iter 44513929.35714336 ns/iter 0.85
Schema_Frame_KrakenD_Reachable 600403501.9998355 ns/iter 629728396.9997807 ns/iter 0.95
Schema_Frame_ISO_Language_Locations_To_JSON 116612919.39999501 ns/iter 123394366.1666596 ns/iter 0.95
Schema_Frame_Many_Resources_References 357496076.99995065 ns/iter 370318712.49996585 ns/iter 0.97
Schema_Bundle_Meta_2020_12 1492368.239402082 ns/iter 1488418.0317792317 ns/iter 1.00
Schema_Format_ISO_Language_To_JSON 106933336.85711488 ns/iter 115906938.99999374 ns/iter 0.92
E2E_Compiler_adaptivecard 58564704.91666717 ns/iter 64891013.09090405 ns/iter 0.90
E2E_Compiler_ansible_meta 26077494.999998197 ns/iter 26488673.423072074 ns/iter 0.98
E2E_Compiler_aws_cdk 335203.1027233944 ns/iter 332592.5751664013 ns/iter 1.01
E2E_Compiler_babelrc 2359472.3535351898 ns/iter 2352966.327702529 ns/iter 1.00
E2E_Compiler_clang_format 16628535.547619365 ns/iter 17310069.999999408 ns/iter 0.96
E2E_Compiler_cmake_presets 26407204.074075706 ns/iter 27076618.15999927 ns/iter 0.98
E2E_Compiler_code_climate 2358938.8783783442 ns/iter 2356645.8417513384 ns/iter 1.00
E2E_Compiler_cql2 13163480.056601776 ns/iter 13368113.576920956 ns/iter 0.98
E2E_Compiler_cspell 23251211.73333476 ns/iter 24376665.500002068 ns/iter 0.95
E2E_Compiler_cypress 4028669.971263695 ns/iter 3999287.4857138568 ns/iter 1.01
E2E_Compiler_deno 7181259.821053525 ns/iter 7274230.437500269 ns/iter 0.99
E2E_Compiler_dependabot 3674332.102563755 ns/iter 3582352.9076925553 ns/iter 1.03
E2E_Compiler_draft_04 2481419.5496456376 ns/iter 2467561.378091793 ns/iter 1.01
E2E_Compiler_fabric_mod 4340871.217391678 ns/iter 4358372.360247983 ns/iter 1.00
E2E_Compiler_geojson 20497663.588230353 ns/iter 21967434.81250252 ns/iter 0.93
E2E_Compiler_gitpod_configuration 4621633.93421041 ns/iter 4622003.7105258955 ns/iter 1.00
E2E_Compiler_helm_chart_lock 632487.0334842528 ns/iter 637896.5495003915 ns/iter 0.99
E2E_Compiler_importmap 249882.01321900968 ns/iter 250875.36386404774 ns/iter 1.00
E2E_Compiler_jasmine 1244309.2615658445 ns/iter 1238474.700884766 ns/iter 1.00
E2E_Compiler_jshintrc 3925960.994382202 ns/iter 3927939.7696628016 ns/iter 1.00
E2E_Compiler_jsconfig 20549619.911762685 ns/iter 21692086.090910602 ns/iter 0.95
E2E_Compiler_krakend 139553497.7999887 ns/iter 156476542.50000188 ns/iter 0.89
E2E_Compiler_lazygit 30719092.65217389 ns/iter 32301299.954548832 ns/iter 0.95
E2E_Compiler_lerna 1455721.7588353977 ns/iter 1461215.5229168402 ns/iter 1.00
E2E_Compiler_nest_cli 6829524.524270259 ns/iter 6883815.617648978 ns/iter 0.99
E2E_Compiler_omc 154533175.99997264 ns/iter 174596677.25000826 ns/iter 0.89
E2E_Compiler_omnisharp 6116412.017544653 ns/iter 6162700.447368096 ns/iter 0.99
E2E_Compiler_openapi 23407161.399995856 ns/iter 23934349.137930594 ns/iter 0.98
E2E_Compiler_pre_commit_hooks 4771633.789116504 ns/iter 4773760.238094837 ns/iter 1.00
E2E_Compiler_pulumi 3684296.668420996 ns/iter 3674045.126315736 ns/iter 1.00
E2E_Compiler_semantic_release 1416779.492929165 ns/iter 1405974.5668015857 ns/iter 1.01
E2E_Compiler_stale 1422363.6361789173 ns/iter 1423734.115384578 ns/iter 1.00
E2E_Compiler_stylecop 5387597.384614869 ns/iter 5487444.9999999795 ns/iter 0.98
E2E_Compiler_tmuxinator 1730837.4222219205 ns/iter 1731491.8044551425 ns/iter 1.00
E2E_Compiler_ui5 47097472.466657564 ns/iter 51679953.38461669 ns/iter 0.91
E2E_Compiler_ui5_manifest 312904320.5000244 ns/iter 359409498.99998033 ns/iter 0.87
E2E_Compiler_unreal_engine_uproject 4201812.389221809 ns/iter 4220013.7333331825 ns/iter 1.00
E2E_Compiler_users_array 802738.2682648562 ns/iter 800891.7665904261 ns/iter 1.00
E2E_Compiler_vercel 12318799.894736703 ns/iter 12854238.581820194 ns/iter 0.96
E2E_Compiler_yamllint 307713.06200529734 ns/iter 310100.2421383783 ns/iter 0.99
E2E_Evaluator_adaptivecard 27082.85966325332 ns/iter 25332.372557452407 ns/iter 1.07
E2E_Evaluator_ansible_meta 252411.83104189552 ns/iter 244831.00800559702 ns/iter 1.03
E2E_Evaluator_aws_cdk 54283.37754401254 ns/iter 54233.99652267663 ns/iter 1.00
E2E_Evaluator_babelrc 119372.14162583293 ns/iter 119252.06684625366 ns/iter 1.00
E2E_Evaluator_cerebrum_criminal_case 1077063.415887748 ns/iter 1107885.3348834848 ns/iter 0.97
E2E_Evaluator_clang_format 120520.04208872876 ns/iter 119857.01542191941 ns/iter 1.01
E2E_Evaluator_cmake_presets 4514918.917198119 ns/iter 6638727.342858277 ns/iter 0.68
E2E_Evaluator_code_climate 187827.80963791703 ns/iter 186696.92171106068 ns/iter 1.01
E2E_Evaluator_cql2 236820.08477339885 ns/iter 221798.09669291077 ns/iter 1.07
E2E_Evaluator_cspell 649377.8621973719 ns/iter 654193.212233515 ns/iter 0.99
E2E_Evaluator_cypress 197136.80212117545 ns/iter 197291.41622379897 ns/iter 1.00
E2E_Evaluator_deno 330511.3789173959 ns/iter 330087.4815864145 ns/iter 1.00
E2E_Evaluator_dependabot 338920.8449951261 ns/iter 337404.3632437609 ns/iter 1.00
E2E_Evaluator_draft_04 8604586.53164642 ns/iter 11993831.759996284 ns/iter 0.72
E2E_Evaluator_fabric_mod 698376.9723865946 ns/iter 706578.4970061127 ns/iter 0.99
E2E_Evaluator_geojson 17301591.29267965 ns/iter 18667229.21621462 ns/iter 0.93
E2E_Evaluator_gitpod_configuration 249566.84464289734 ns/iter 251903.00859376794 ns/iter 0.99
E2E_Evaluator_helm_chart_lock 328839.04558265564 ns/iter 326337.9226049782 ns/iter 1.01
E2E_Evaluator_importmap 52877.78344705367 ns/iter 51680.917217063325 ns/iter 1.02
E2E_Evaluator_jasmine 109755.21388278039 ns/iter 109910.70288039258 ns/iter 1.00
E2E_Evaluator_jshintrc 1222753.7431036925 ns/iter 1225256.7223201091 ns/iter 1.00
E2E_Evaluator_jsconfig 437727.05157235754 ns/iter 435195.034140313 ns/iter 1.01
E2E_Evaluator_krakend 226648.20854756236 ns/iter 223576.73928571455 ns/iter 1.01
E2E_Evaluator_lazygit 161867.25724137743 ns/iter 155954.09562721124 ns/iter 1.04
E2E_Evaluator_lerna 150541.55634564764 ns/iter 150900.04368823796 ns/iter 1.00
E2E_Evaluator_nest_cli 198902.86306818438 ns/iter 197947.72981548772 ns/iter 1.00
E2E_Evaluator_omc 23054.00265147725 ns/iter 21783.697404604543 ns/iter 1.06
E2E_Evaluator_omnisharp 628369.3799822057 ns/iter 621394.2251122007 ns/iter 1.01
E2E_Evaluator_openapi 13568489.020409122 ns/iter 19155419.236845344 ns/iter 0.71
E2E_Evaluator_pre_commit_hooks 515911.05379509216 ns/iter 517371.0572266718 ns/iter 1.00
E2E_Evaluator_pulumi 708255.5567950418 ns/iter 708539.9117042632 ns/iter 1.00
E2E_Evaluator_semantic_release 105298.47275975245 ns/iter 106514.87817028325 ns/iter 0.99
E2E_Evaluator_stale 156592.6197119845 ns/iter 155753.63975984007 ns/iter 1.01
E2E_Evaluator_stylecop 304667.6177370046 ns/iter 305350.891313799 ns/iter 1.00
E2E_Evaluator_tmuxinator 104196.9697284407 ns/iter 104001.1316259601 ns/iter 1.00
E2E_Evaluator_ui5 544182.6645668641 ns/iter 539891.7793210482 ns/iter 1.01
E2E_Evaluator_ui5_manifest 2724524.0000005704 ns/iter 4080303.6306817313 ns/iter 0.67
E2E_Evaluator_unreal_engine_uproject 463808.1123670311 ns/iter 469960.60843376815 ns/iter 0.99
E2E_Evaluator_users_array 595515.6211179541 ns/iter 627218.4762757869 ns/iter 0.95
E2E_Evaluator_vercel 333627.8994307116 ns/iter 328452.73405244225 ns/iter 1.02
E2E_Evaluator_yamllint 9511.083481043832 ns/iter 9305.168645244099 ns/iter 1.02
JSONLD_Catalog_Simple 25741171.148149952 ns/iter 32101313.590911474 ns/iter 0.80
JSONLD_Catalog_Override_Agreeing 26151973.62963415 ns/iter 31615521.454537805 ns/iter 0.83
JSONLD_Catalog_Override_Shadowing 38276234.444437146 ns/iter 46847618.40000343 ns/iter 0.82
Micro_Draft4_Meta_1_No_Callback 197.9043962359822 ns/iter 190.90139608238977 ns/iter 1.04
Micro_Draft4_Required_Properties 802.5807528072016 ns/iter 803.8490072908879 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 23.568193470364626 ns/iter 23.548059165528162 ns/iter 1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.865330702941877 ns/iter 11.84531697656612 ns/iter 1.00
Micro_Draft4_Items_Schema 277.55237733599324 ns/iter 277.8113796727985 ns/iter 1.00
Micro_Draft4_Nested_Object 1.8675692106781672 ns/iter 1.8680011239012808 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 327.15397382860044 ns/iter 327.43589101104016 ns/iter 1.00
Micro_Draft4_Properties_Triad_Closed 269.89463684931854 ns/iter 287.0082997455845 ns/iter 0.94
Micro_Draft4_Properties_Triad_Required 345.34621488289986 ns/iter 345.59320631454824 ns/iter 1.00
Micro_Draft4_Properties_Closed 61.910434208682716 ns/iter 62.00171821913106 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 13.965762031521832 ns/iter 13.964361193156341 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 158.14838091770403 ns/iter 158.16302853016415 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 11.865733669689869 ns/iter 11.897842354306816 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 33.00805047835996 ns/iter 33.01309765729041 ns/iter 1.00
Micro_Draft4_Nested_Oneof 60.8169522043938 ns/iter 60.75548030848499 ns/iter 1.00
Micro_Draft4_Short_Enum 12.180771617238532 ns/iter 12.332912978459065 ns/iter 0.99
Micro_Draft4_Long_Enum 14.66019021030341 ns/iter 15.901270970894736 ns/iter 0.92
Micro_Draft4_Long_Enum_Short_Strings 12.15737467572582 ns/iter 12.279213967991675 ns/iter 0.99
Micro_Draft4_Type_Object 3.426629294462126 ns/iter 3.424068414849999 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2410775.7010307317 ns/iter 2402084.6391759887 ns/iter 1.00
Micro_Draft4_Compile_Ref_Many_Nested 1750321.0100252621 ns/iter 1780146.7099997126 ns/iter 0.98
Micro_Draft4_Compile_Wrap 2381743.217687144 ns/iter 2373043.4508475596 ns/iter 1.00
Micro_Draft6_Property_Names 143.28612814415644 ns/iter 143.33368437165208 ns/iter 1.00
Micro_Draft6_Compile_FHIR 14803465326.00015 ns/iter 20097789819.000126 ns/iter 0.74
Micro_Draft7_If_Then_Else 22.457507174367965 ns/iter 22.431507258241595 ns/iter 1.00
Micro_2019_09_Unevaluated_Properties 27.768069221617502 ns/iter 27.742234835639163 ns/iter 1.00
Micro_2019_09_Compile_Wrap 295490433.99993026 ns/iter 337287450.99995196 ns/iter 0.88
Micro_2020_12_Dynamic_Ref 697.0070574102252 ns/iter 703.8056570597704 ns/iter 0.99
Micro_2020_12_Dynamic_Ref_Single 3.431014876279455 ns/iter 3.424903508680499 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1304.1791155850187 ns/iter 1115.1460644520166 ns/iter 1.17
Micro_2020_12_Simple_Output_Annotations 71352.61842371504 ns/iter 71293.94138000772 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotation_Dropping 1674829.3980817967 ns/iter 1689101.8891564305 ns/iter 0.99
Micro_2020_12_Compile_NonCircular_Shared_Refs 999292.9216523123 ns/iter 1004537.4436519241 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric 8455.631233866165 ns/iter 8642.018175570216 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 44591.66740703097 ns/iter 45906.14424338701 ns/iter 0.97
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 23281.736207864644 ns/iter 22911.483745034886 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 151.87052092642395 ns/iter 159.77653640754764 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 2932.597407466312 ns/iter 2875.9077683244573 ns/iter 1.02
Alterschema_Check_Readibility_ISO_Language_Set_3 371267005.5000444 ns/iter 410687452.0000474 ns/iter 0.90
Alterschema_Check_Readibility_OMC 86199694.75000744 ns/iter 97094448.00000711 ns/iter 0.89
Alterschema_Check_Readibility_KrakenD 1202584984.9999304 ns/iter 1341378025.00004 ns/iter 0.90
Alterschema_Apply_Readibility_KrakenD 117926088254.99997 ns/iter 134923026914.00005 ns/iter 0.87
Alterschema_Check_Invalid_External_Refs 302359238.5000029 ns/iter 309446274.0000381 ns/iter 0.98

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: b503eaf Previous: 6ea1ec2 Ratio
E2E_Evaluator_adaptivecard 119744 ns 127184 ns 0.94
E2E_Evaluator_ansible-meta 525128 ns 561499 ns 0.94
E2E_Evaluator_aws-cdk 144095 ns 148911 ns 0.97
E2E_Evaluator_babelrc 336966 ns 385627 ns 0.87
E2E_Evaluator_cerebrum-criminal-case 2513308 ns 2864078 ns 0.88
E2E_Evaluator_clang-format 256813 ns 292914 ns 0.88
E2E_Evaluator_cmake-presets 17938063 ns 20695850 ns 0.87
E2E_Evaluator_code-climate 522754 ns 529009 ns 0.99
E2E_Evaluator_cql2 1359479 ns 1276486 ns 1.07
E2E_Evaluator_cspell 1468790 ns 1657931 ns 0.89
E2E_Evaluator_cypress 779574 ns 866432 ns 0.90
E2E_Evaluator_deno 1043270 ns 1132137 ns 0.92
E2E_Evaluator_dependabot 1109959 ns 1168051 ns 0.95
E2E_Evaluator_draft-04 20781123 ns 23575248 ns 0.88
E2E_Evaluator_fabric-mod 2323026 ns 2573072 ns 0.90
E2E_Evaluator_geojson 23758016 ns 27229609 ns 0.87
E2E_Evaluator_gitpod-configuration 718584 ns 757466 ns 0.95
E2E_Evaluator_helm-chart-lock 994183 ns 1004911 ns 0.99
E2E_Evaluator_importmap 267027 ns 274254 ns 0.97
E2E_Evaluator_jasmine 286211 ns 318328 ns 0.90
E2E_Evaluator_jsconfig 1240875 ns 1389211 ns 0.89
E2E_Evaluator_jshintrc 2888497 ns 3054427 ns 0.95
E2E_Evaluator_krakend 686424 ns 687975 ns 1.00
E2E_Evaluator_lazygit 509336 ns 537802 ns 0.95
E2E_Evaluator_lerna 473324 ns 486831 ns 0.97
E2E_Evaluator_nest-cli 616291 ns 631605 ns 0.98
E2E_Evaluator_omc 116041 ns 121254 ns 0.96
E2E_Evaluator_omnisharp 1431704 ns 1544976 ns 0.93
E2E_Evaluator_openapi 42132591 ns 45871427 ns 0.92
E2E_Evaluator_pre-commit-hooks 1979179 ns 2217219 ns 0.89
E2E_Evaluator_pulumi 1927808 ns 2023446 ns 0.95
E2E_Evaluator_semantic-release 259357 ns 269989 ns 0.96
E2E_Evaluator_stale 395113 ns 397351 ns 0.99
E2E_Evaluator_stylecop 1151575 ns 1246506 ns 0.92
E2E_Evaluator_tmuxinator 230602 ns 241560 ns 0.95
E2E_Evaluator_ui5 2175131 ns 2273449 ns 0.96
E2E_Evaluator_ui5-manifest 10357323 ns 14571005 ns 0.71
E2E_Evaluator_unreal-engine-uproject 1528000 ns 1566512 ns 0.98
E2E_Evaluator_users-array 3046476 ns 4471209 ns 0.68
E2E_Evaluator_vercel 993357 ns 1045254 ns 0.95
E2E_Evaluator_yamllint 25585 ns 26337 ns 0.97

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: b503eaf Previous: 6ea1ec2 Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 355094194.9999924 ns/iter 350167788.0000216 ns/iter 1.01
Alterschema_Check_Readibility_OMC 95345427.28572758 ns/iter 95104973.85713279 ns/iter 1.00
Alterschema_Check_Readibility_KrakenD 1318153351.9998538 ns/iter 1318782227.0001562 ns/iter 1.00
Alterschema_Apply_Readibility_KrakenD 136135884341.99983 ns/iter 124235083365.00003 ns/iter 1.10
Alterschema_Check_Invalid_External_Refs 322208738.9999615 ns/iter 322274915.49997467 ns/iter 1.00
Micro_2020_12_Dynamic_Ref 808.6902638953792 ns/iter 897.6309658085827 ns/iter 0.90
Micro_2020_12_Dynamic_Ref_Single 4.670019317307062 ns/iter 4.670457127029039 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1122.4411111608142 ns/iter 1120.3063816991782 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 84382.51794934011 ns/iter 82661.6221751582 ns/iter 1.02
Micro_2020_12_Simple_Output_Annotation_Dropping 1917598.7217630923 ns/iter 1908109.0461956207 ns/iter 1.00
Micro_2020_12_Compile_NonCircular_Shared_Refs 1127141.7195512885 ns/iter 1112200.5863707403 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric 8888.813000981401 ns/iter 8822.505102104828 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 52807.62459721173 ns/iter 52888.25557001103 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 25753.25915107365 ns/iter 25591.167215513167 ns/iter 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 157.40077032785203 ns/iter 168.07652041602097 ns/iter 0.94
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 3341.068442976318 ns/iter 3260.703938088764 ns/iter 1.02
Micro_2019_09_Unevaluated_Properties 30.529824258472782 ns/iter 30.538821669673883 ns/iter 1.00
Micro_2019_09_Compile_Wrap 313248527.5000363 ns/iter 303451520.99994266 ns/iter 1.03
Micro_Draft7_If_Then_Else 24.715802987304407 ns/iter 24.606069958977336 ns/iter 1.00
Micro_Draft6_Property_Names 158.15087983094287 ns/iter 158.35617202841019 ns/iter 1.00
Micro_Draft6_Compile_FHIR 14624185887.000067 ns/iter 13798442241.999964 ns/iter 1.06
Micro_Draft4_Meta_1_No_Callback 183.00290580365112 ns/iter 183.2430931265689 ns/iter 1.00
Micro_Draft4_Required_Properties 907.5142461337432 ns/iter 906.639364659348 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.976259711350224 ns/iter 21.86677125240648 ns/iter 1.01
Micro_Draft4_Few_Optional_Properties_Minimal_Match 15.572797700996176 ns/iter 15.579673046339138 ns/iter 1.00
Micro_Draft4_Items_Schema 324.253469711145 ns/iter 335.2218138101693 ns/iter 0.97
Micro_Draft4_Nested_Object 1.8665790948583638 ns/iter 1.8676987107934049 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 465.6342814413577 ns/iter 394.5700563730175 ns/iter 1.18
Micro_Draft4_Properties_Triad_Closed 381.49180189750615 ns/iter 332.797538896769 ns/iter 1.15
Micro_Draft4_Properties_Triad_Required 486.6499962983945 ns/iter 435.40187334970955 ns/iter 1.12
Micro_Draft4_Properties_Closed 63.595572241321015 ns/iter 63.63397373941731 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 9.03319877915392 ns/iter 9.027819032973756 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 210.9596658205838 ns/iter 211.34719637208462 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 15.575434872736169 ns/iter 15.590541707560789 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 14.387529737627295 ns/iter 14.333512017570403 ns/iter 1.00
Micro_Draft4_Nested_Oneof 63.49251571893436 ns/iter 63.58436721197823 ns/iter 1.00
Micro_Draft4_Short_Enum 14.642196229611876 ns/iter 14.663904433255999 ns/iter 1.00
Micro_Draft4_Long_Enum 13.092351135827913 ns/iter 13.405034284476653 ns/iter 0.98
Micro_Draft4_Long_Enum_Short_Strings 14.658789979391454 ns/iter 14.672448919753444 ns/iter 1.00
Micro_Draft4_Type_Object 4.667650387358168 ns/iter 4.673672335722623 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2513848.2775798375 ns/iter 2468725.0600704877 ns/iter 1.02
Micro_Draft4_Compile_Ref_Many_Nested 1813958.1627906114 ns/iter 1797900.7139171334 ns/iter 1.01
Micro_Draft4_Compile_Wrap 2596664.0666663605 ns/iter 2582760.191882289 ns/iter 1.01
JSONLD_Catalog_Simple 28082368.360001054 ns/iter 27974612.520001754 ns/iter 1.00
JSONLD_Catalog_Override_Agreeing 28359737.840000886 ns/iter 27852490.240002226 ns/iter 1.02
JSONLD_Catalog_Override_Shadowing 39962743.50000325 ns/iter 38912723.722218186 ns/iter 1.03
E2E_Compiler_adaptivecard 63761004.90909018 ns/iter 62294128.27271765 ns/iter 1.02
E2E_Compiler_ansible_meta 29176979.41667067 ns/iter 28766814.62499657 ns/iter 1.01
E2E_Compiler_aws_cdk 382409.6227545417 ns/iter 379840.1650379105 ns/iter 1.01
E2E_Compiler_babelrc 2579990.352941763 ns/iter 2548024.9708033274 ns/iter 1.01
E2E_Compiler_clang_format 17921480.615384027 ns/iter 17635424.224999953 ns/iter 1.02
E2E_Compiler_cmake_presets 26608726.80769444 ns/iter 26763944.076929666 ns/iter 0.99
E2E_Compiler_code_climate 2588561.3431732445 ns/iter 2583013.11111053 ns/iter 1.00
E2E_Compiler_cql2 14126451.339998312 ns/iter 14149849.89795979 ns/iter 1.00
E2E_Compiler_cspell 23574942.833336838 ns/iter 23753066.200000223 ns/iter 0.99
E2E_Compiler_cypress 4090215.578946555 ns/iter 4091772.4823537036 ns/iter 1.00
E2E_Compiler_deno 8043183.7931030905 ns/iter 8019002.613635126 ns/iter 1.00
E2E_Compiler_dependabot 3882098.2265192647 ns/iter 3863288.1436474263 ns/iter 1.00
E2E_Compiler_draft_04 2784351.737052176 ns/iter 2759243.1732280487 ns/iter 1.01
E2E_Compiler_fabric_mod 4741453.229729433 ns/iter 4699885.040269307 ns/iter 1.01
E2E_Compiler_geojson 22650351.38709443 ns/iter 22572496.516131062 ns/iter 1.00
E2E_Compiler_gitpod_configuration 5007700.221428228 ns/iter 4990474.892857882 ns/iter 1.00
E2E_Compiler_helm_chart_lock 685109.372070336 ns/iter 677623.842926861 ns/iter 1.01
E2E_Compiler_importmap 282587.09017714736 ns/iter 281048.5114965748 ns/iter 1.01
E2E_Compiler_jasmine 1365351.2058248702 ns/iter 1360220.4922181717 ns/iter 1.00
E2E_Compiler_jshintrc 4295473.196318053 ns/iter 4209115.373493868 ns/iter 1.02
E2E_Compiler_jsconfig 21392001.757579815 ns/iter 21215757.90908647 ns/iter 1.01
E2E_Compiler_krakend 137727712.00001442 ns/iter 144049058.0000187 ns/iter 0.96
E2E_Compiler_lazygit 32793176.85714237 ns/iter 32871227.190471906 ns/iter 1.00
E2E_Compiler_lerna 1605725.0275228966 ns/iter 1596994.7162468974 ns/iter 1.01
E2E_Compiler_nest_cli 7369212.463158635 ns/iter 7331495.677083429 ns/iter 1.01
E2E_Compiler_omc 166708792.24994907 ns/iter 172167486.7500269 ns/iter 0.97
E2E_Compiler_omnisharp 6571638.635514063 ns/iter 6531969.934578959 ns/iter 1.01
E2E_Compiler_openapi 26090118.55555663 ns/iter 25991503.846153837 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 5236196.380597401 ns/iter 5158861.566176189 ns/iter 1.01
E2E_Compiler_pulumi 4033125.735632559 ns/iter 4035873.4367820383 ns/iter 1.00
E2E_Compiler_semantic_release 1561859.6080179273 ns/iter 1559358.7738355952 ns/iter 1.00
E2E_Compiler_stale 1553266.2749444195 ns/iter 1544595.798226179 ns/iter 1.01
E2E_Compiler_stylecop 5888529.745762153 ns/iter 5878048.6470582485 ns/iter 1.00
E2E_Compiler_tmuxinator 1928151.9479454178 ns/iter 1902990.7499994736 ns/iter 1.01
E2E_Compiler_ui5 48257316.999995835 ns/iter 48774081.599988975 ns/iter 0.99
E2E_Compiler_ui5_manifest 319497998.00008804 ns/iter 324618315.5000608 ns/iter 0.98
E2E_Compiler_unreal_engine_uproject 4515354.098039335 ns/iter 4512321.967742185 ns/iter 1.00
E2E_Compiler_users_array 881085.2048039696 ns/iter 882763.6371680651 ns/iter 1.00
E2E_Compiler_vercel 12664660.236363158 ns/iter 12648721.8000007 ns/iter 1.00
E2E_Compiler_yamllint 351126.38360991626 ns/iter 350227.5835835626 ns/iter 1.00
E2E_Evaluator_adaptivecard 25171.816040916397 ns/iter 25113.191065588184 ns/iter 1.00
E2E_Evaluator_ansible_meta 281913.9475609592 ns/iter 282768.2208266052 ns/iter 1.00
E2E_Evaluator_aws_cdk 61612.25758240527 ns/iter 62074.243625821866 ns/iter 0.99
E2E_Evaluator_babelrc 117629.15359371416 ns/iter 118199.65400002275 ns/iter 1.00
E2E_Evaluator_cerebrum_criminal_case 1128508.1395730327 ns/iter 1119682.7045454213 ns/iter 1.01
E2E_Evaluator_clang_format 111830.39847796838 ns/iter 113228.0022346527 ns/iter 0.99
E2E_Evaluator_cmake_presets 4700386.3767118575 ns/iter 5070537.150000594 ns/iter 0.93
E2E_Evaluator_code_climate 228503.36724086976 ns/iter 228163.26560979555 ns/iter 1.00
E2E_Evaluator_cql2 221726.32406245894 ns/iter 220547.37120257254 ns/iter 1.01
E2E_Evaluator_cspell 626190.4648506967 ns/iter 612793.4043668248 ns/iter 1.02
E2E_Evaluator_cypress 186868.74178788552 ns/iter 187925.03691732968 ns/iter 0.99
E2E_Evaluator_deno 354689.6035264485 ns/iter 360585.8322112458 ns/iter 0.98
E2E_Evaluator_dependabot 381481.9891066808 ns/iter 379691.95125952316 ns/iter 1.00
E2E_Evaluator_draft_04 9136565.652776577 ns/iter 8626357.866666391 ns/iter 1.06
E2E_Evaluator_fabric_mod 778124.3625275444 ns/iter 777912.9988864218 ns/iter 1.00
E2E_Evaluator_geojson 16687147.523807004 ns/iter 17222104.365856003 ns/iter 0.97
E2E_Evaluator_gitpod_configuration 265394.2324110471 ns/iter 266730.0904295634 ns/iter 0.99
E2E_Evaluator_helm_chart_lock 321614.7421874972 ns/iter 329366.2700558774 ns/iter 0.98
E2E_Evaluator_importmap 50221.528517109065 ns/iter 49824.30534296442 ns/iter 1.01
E2E_Evaluator_jasmine 123569.08894403903 ns/iter 125099.23849296919 ns/iter 0.99
E2E_Evaluator_jshintrc 1106800.9731863714 ns/iter 1104114.3412321515 ns/iter 1.00
E2E_Evaluator_jsconfig 441977.64768452 ns/iter 440514.1007556847 ns/iter 1.00
E2E_Evaluator_krakend 219497.11111109916 ns/iter 216600.13324835376 ns/iter 1.01
E2E_Evaluator_lazygit 147042.8977128291 ns/iter 148832.79059372345 ns/iter 0.99
E2E_Evaluator_lerna 171187.51524684372 ns/iter 167858.67193194592 ns/iter 1.02
E2E_Evaluator_nest_cli 205372.1692353121 ns/iter 208447.719512193 ns/iter 0.99
E2E_Evaluator_omc 22818.495100292548 ns/iter 23199.199583930185 ns/iter 0.98
E2E_Evaluator_omnisharp 579075.7867219466 ns/iter 577833.399501683 ns/iter 1.00
E2E_Evaluator_openapi 15607525.209303318 ns/iter 16172826.534885157 ns/iter 0.97
E2E_Evaluator_pre_commit_hooks 536257.1313980531 ns/iter 544120.1959406112 ns/iter 0.99
E2E_Evaluator_pulumi 778546.6035632925 ns/iter 778294.8573021976 ns/iter 1.00
E2E_Evaluator_semantic_release 107404.45717358754 ns/iter 110777.8548287594 ns/iter 0.97
E2E_Evaluator_stale 176660.9117498992 ns/iter 173299.49887808962 ns/iter 1.02
E2E_Evaluator_stylecop 313681.50427736435 ns/iter 320504.2372029325 ns/iter 0.98
E2E_Evaluator_tmuxinator 108333.8378963586 ns/iter 108822.9799372734 ns/iter 1.00
E2E_Evaluator_ui5 586615.4301253561 ns/iter 601001.2058569114 ns/iter 0.98
E2E_Evaluator_ui5_manifest 2994389.44827557 ns/iter 3131072.385964504 ns/iter 0.96
E2E_Evaluator_unreal_engine_uproject 482081.82426772243 ns/iter 489924.93328694714 ns/iter 0.98
E2E_Evaluator_users_array 651732.5742295965 ns/iter 680959.7199999854 ns/iter 0.96
E2E_Evaluator_vercel 343442.6922321544 ns/iter 351426.65277788416 ns/iter 0.98
E2E_Evaluator_yamllint 12969.820268322259 ns/iter 13218.8887879225 ns/iter 0.98
Schema_Format_ISO_Language_To_JSON 112558273.00002845 ns/iter 114790046.49993385 ns/iter 0.98
Schema_Bundle_Meta_2020_12 1817450.4857107457 ns/iter 1815486.2357543109 ns/iter 1.00
Schema_Frame_WoT_References 5352705.874999586 ns/iter 5299089.265151631 ns/iter 1.01
Schema_Frame_OMC_References 22434011.58064502 ns/iter 22695261.096773278 ns/iter 0.99
Schema_Frame_OMC_Locations 20730854.088235583 ns/iter 20606327.687502813 ns/iter 1.01
Schema_Frame_ISO_Language_Locations 104116966.14284794 ns/iter 106790385.99999201 ns/iter 0.97
Schema_Frame_KrakenD_References 39185969.444449455 ns/iter 39714363.777786985 ns/iter 0.99
Schema_Frame_KrakenD_Reachable 538934512.9999583 ns/iter 559747977.0001428 ns/iter 0.96
Schema_Frame_ISO_Language_Locations_To_JSON 180747672.49999014 ns/iter 184156896.49998513 ns/iter 0.98
Schema_Frame_Many_Resources_References 392369965.00005716 ns/iter 394888565.0000875 ns/iter 0.99
Schema_Iterator_ISO_Language 3980909.2159091816 ns/iter 3853377.74585584 ns/iter 1.03
Schema_Tracker_ISO_Language 5358239.7404587045 ns/iter 5165104.602941911 ns/iter 1.04
Schema_Tracker_ISO_Language_To_JSON 28303824.959994014 ns/iter 27611381.75999804 ns/iter 1.03

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: b503eaf Previous: 6ea1ec2 Ratio
E2E_Evaluator_adaptivecard 120032 ns 119527 ns 1.00
E2E_Evaluator_ansible-meta 519116 ns 519066 ns 1.00
E2E_Evaluator_aws-cdk 147172 ns 140741 ns 1.05
E2E_Evaluator_babelrc 336782 ns 341818 ns 0.99
E2E_Evaluator_cerebrum-criminal-case 2513874 ns 2440451 ns 1.03
E2E_Evaluator_clang-format 255042 ns 255504 ns 1.00
E2E_Evaluator_cmake-presets 18042921 ns 17318171 ns 1.04
E2E_Evaluator_code-climate 516781 ns 502614 ns 1.03
E2E_Evaluator_cql2 1304317 ns 1241716 ns 1.05
E2E_Evaluator_cspell 1467260 ns 1472971 ns 1.00
E2E_Evaluator_cypress 756310 ns 758263 ns 1.00
E2E_Evaluator_deno 1033510 ns 1027912 ns 1.01
E2E_Evaluator_dependabot 1109199 ns 1099438 ns 1.01
E2E_Evaluator_draft-04 21313789 ns 21555236 ns 0.99
E2E_Evaluator_fabric-mod 2322023 ns 2293814 ns 1.01
E2E_Evaluator_geojson 23453143 ns 24923899 ns 0.94
E2E_Evaluator_gitpod-configuration 710780 ns 699799 ns 1.02
E2E_Evaluator_helm-chart-lock 1027038 ns 1049617 ns 0.98
E2E_Evaluator_importmap 263696 ns 262253 ns 1.01
E2E_Evaluator_jasmine 304317 ns 284753 ns 1.07
E2E_Evaluator_jsconfig 1209340 ns 1232814 ns 0.98
E2E_Evaluator_jshintrc 2727333 ns 2778580 ns 0.98
E2E_Evaluator_krakend 671642 ns 674108 ns 1.00
E2E_Evaluator_lazygit 503208 ns 503707 ns 1.00
E2E_Evaluator_lerna 459529 ns 458104 ns 1.00
E2E_Evaluator_nest-cli 591063 ns 585436 ns 1.01
E2E_Evaluator_omc 118153 ns 118912 ns 0.99
E2E_Evaluator_omnisharp 1395447 ns 1386858 ns 1.01
E2E_Evaluator_openapi 42202956 ns 45830300 ns 0.92
E2E_Evaluator_pre-commit-hooks 1951744 ns 1978738 ns 0.99
E2E_Evaluator_pulumi 1889503 ns 1913208 ns 0.99
E2E_Evaluator_semantic-release 251710 ns 259698 ns 0.97
E2E_Evaluator_stale 400046 ns 395517 ns 1.01
E2E_Evaluator_stylecop 1165934 ns 1161685 ns 1.00
E2E_Evaluator_tmuxinator 223254 ns 232084 ns 0.96
E2E_Evaluator_ui5 2276546 ns 2253815 ns 1.01
E2E_Evaluator_ui5-manifest 10519365 ns 11192002 ns 0.94
E2E_Evaluator_unreal-engine-uproject 1482497 ns 1488427 ns 1.00
E2E_Evaluator_users-array 3160586 ns 2982119 ns 1.06
E2E_Evaluator_vercel 982813 ns 964756 ns 1.02
E2E_Evaluator_yamllint 25531 ns 25886 ns 0.99

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti
jviotti merged commit 4bae05e into main Aug 3, 2026
14 checks passed
@jviotti
jviotti deleted the test-rdf branch August 3, 2026 19:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant