Skip to content

Phase 6: Invalid, Partition, diagnose, github_matrix - #57

Merged
adolgert merged 8 commits into
feature/phase5-measurefrom
feature/phase6-features
Oct 3, 2026
Merged

adolgert merged 8 commits into
feature/phase5-measurefrom
feature/phase6-features

Conversation

@adolgert

Copy link
Copy Markdown
Owner

Phase 6 of design/20260926_implementation_plan.md, stacked on #56. Review note with the complete target-screen transcript and open decisions: design/phase6_review.md.

  • Invalid: the covering design is built over ordinary values, then each invalid value's negative targets (contract §6) are classified and covered by a sub-request with the same engine; results keep separate negative bookkeeping, mark negative rows with !, and report states the two guarantees. Must-include, full factorial, and excursions accept wrappers under their row policies.
  • Partition: results keep the wrapper; realize(case; rng) and realize(cases; rng) draw once per partition under the caller's generator.
  • diagnose(cases, passed): ranked suspects grouped by identical failure patterns, explicit statuses for no failures, all failures, and conflicting duplicates; followups finds an isolating case or proves inseparable/indistinguishable/unknown. Marked experimental.
  • github_matrix(cases): a validated {"include": [...]} via JSON.jl; wrappers, non-finite numbers, missing, and collections rejected naming row and field before anything is written.
  • Oracle agreement on both ordinary and negative parts across fixtures and 100 random problems; parsed-JSON comparisons; no pending tests remain.

Full suite: 276,387 pass, 0 pending, 0 failures. Aqua green.

🤖 Generated with Claude Code

adolgert and others added 2 commits September 27, 2026 19:58
…matrix

Negative targets are classified through the negative-row search and
covered by a sub-request over the other parameters with the same engine,
with separate bookkeeping and a ! marker on negative rows. Must-include,
full factorial, and excursions accept wrappers under their row policies.
realize draws each Partition once under the caller's rng. diagnose ranks
combinations present only in failing cases and groups indistinguishable
ones; followups finds isolating cases or proves there are none.
github_matrix writes a validated GitHub Actions include matrix with
JSON.jl.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
figures, JSON field-name validation

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@adolgert

Copy link
Copy Markdown
Owner Author

Review round 1 applied (see design/phase6_review.md): followups searches ordinary and every eligible negative row kind before claiming inseparable, reports the found row's kind, and the brute-force checker now verifies claims against negative rows too (an exhaustive sweep over every outcome vector on three small spaces would have caught the original bug); the prefix curve, bonus coverage, and design_sizes keep ordinary and negative figures apart, labeled, with spaces without Invalid values printing exactly as before; github_matrix validates field names as UTF-8 before writing.

Full suite: 309,720 pass, 0 pending, 0 failures.

🤖 Generated with Claude Code

adolgert and others added 5 commits September 27, 2026 21:00
The docs environment pinned Documenter 0.25, which needs JSON 0.21, while
the package now requires JSON 1, so CI could not resolve it. Documenter 1
makes missing docstrings and unresolved references errors by default;
they stay warnings until Phase 7 completes the manual.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
README and home page lead with the promise, the decision table, and one
example with its printed output. The manual is a tutorial in five levels,
nine how-to guides by job, explanation pages on values and oracles,
interaction coverage and its evidence, constraints, and the engines, a
reference organized by purpose with every exported docstring opening on
the situation it serves, a 0.4 to 0.5 migration table, developer pages,
and a one-pager for AI agents. Doctests run in the docs build and in the
test suite; the build fails on any warning.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
wording, two-check lockfile pattern, badge and contract wording

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Phase 7: documentation and first contact
@adolgert adolgert closed this Oct 3, 2026
@adolgert adolgert reopened this Oct 3, 2026
@adolgert
adolgert merged commit bec4784 into feature/phase5-measure Oct 3, 2026
21 checks passed
@adolgert
adolgert deleted the feature/phase6-features branch October 3, 2026 15:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant