Repository navigation

fix: semantic drift within min_similarity no longer fails runs; tool evaluators skip tool-free suites - #50

Merged

babaliauskas merged 11 commits into

mainfrom

fix/semantic-gate-tool-free-suites

Oct 12, 2026

Merged

fix: semantic drift within min_similarity no longer fails runs; tool evaluators skip tool-free suites#50
babaliauskas merged 11 commits into
mainfrom
fix/semantic-gate-tool-free-suites

Commits on Oct 11, 2026
- docs(plan): semantic gate and tool-free suites
  
  babaliauskas
  and
  claude
  committed
  5a20728
- refactor(analysis): share the semantic within-tolerance rule
  
  babaliauskas
  and
  claude
  committed
  53a6886
- fix(analysis): test semantic drift against min_similarity, not raw deltas
  
  babaliauskas
  and
  claude
  committed
  4706221
- fix(policy): give a severity-driven fail a reason
  
  babaliauskas
  and
  claude
  committed
  5272c7f
- fix(insights): name the real cause of a fail and count critical honestly
  
  babaliauskas
  and
  claude
  committed
  23989c9
- fix(evaluate): tool evaluators do not apply to pairs offered no tools
  
  babaliauskas
  and
  claude
  committed
  f95940e
- docs: semantic tolerance in the paired test; tool-free suites skip tool evaluators
  
  babaliauskas
  and
  claude
  committed
  f34e6b1
- fix(insights): name a breached slice budget as a fail's cause
  
  babaliauskas
  and
  claude
  committed
  4810b5b
- test(analysis): pin effect size and its CI to tolerance-adjusted deltas
  
  babaliauskas
  and
  claude
  committed
  79bd85d
- fix(compare): show the tool-free warning evaluate scored quietly
  
  babaliauskas
  and
  claude
  committed
  de5ee69
- docs: tool-free pairs are not attempted; changelog precision
  
  babaliauskas
  and
  claude
  committed
  6410725