Skip to content

feat(lp): add learning progressions generation, tests, docs, and evaluation - #33

Merged
tonyzhao6 merged 105 commits into
mainfrom
tz6/lp-kg-build-step-30
Sep 24, 2026
Merged

tonyzhao6 merged 105 commits into
mainfrom
tz6/lp-kg-build-step-30

Conversation

@tonyzhao6

@tonyzhao6 tonyzhao6 commented Sep 21, 2026 •

Copy link
Copy Markdown
Contributor

Reviewer: @MustafaAkolawala


Main Changes

  1. Implemented LP KG artifact generation after AS + LC steps.
  2. Added docs for LP KG pipeline
  3. Added tests for LP KG modules
  4. NB: There is now a make test TEST_ARGS=--run-slow that only applies locally. this will triggers long-running tests that take a while. CI does not invoke this, it still does make test.

To-do before merge (optional)

Best way to review PR is to start with tz6/lp-kg-build-step-2 branch and go thru one build step at a time to understand each new file change/addition. Can also skip branches if you want to review multiple files at a time. The engineering brief in artifacts/instructions is good context for understanding the overall goal of this PR and the build steps.

Checklist

Fill with x for completed.

  • My code follows the style guidelines of this project
  • I have reviewed my own code to ensure good quality
  • I have tested the functionality of my code to ensure it works as intended
  • I have resolved merge conflicts
  • I have ensured that my PR branch is up to date with the merge branch

(Delete any items below that are not relevant)

  • I have updated the test suite
  • I have updated dependencies
  • I have updated affected documentation (including READMEs)
  • I have updated scripts in .github/
  • I have updated CDK stacks

tonyzhao6 added 30 commits August 31, 2026 16:18
- record approved D1-D14 decisions and accepted LIMITs
- align role guidance and release gates with D12-D14
- define the approved Steps 24-29 workflow
tonyzhao6 added 21 commits September 16, 2026 12:37
Retain the generation lock after successful production completion.
Enforce grounding consistency while preserving valid ambiguity.
Align evaluator configuration tests with the approved model default.
Add offline grounding, retry, cache, and model-availability coverage.
…checks

Preserve the fixed development selection and original artifact hashes while
capturing current lock state in temporary snapshots. Add regression coverage
rejecting lock appearance after freezing.

Validate the full offline suite including slow tests: 4167 passed.
Use synthetic temporary snapshots and a fixed synthetic historical fixture.
Preserve full validation and material binding, reject repository-results
reads, and cover corruption across both checkpoint formats.

Validate the full offline suite including slow tests: 4179 passed.
…P responses

Bind effective output schemas, modes and SDK versions.
Validate original provider envelopes before SDK normalization.
Preserve safe diagnostics, raw output and per-attempt usage.
Cover bounded retries, durable exhaustion and cache compatibility.
Expose canonical citations for nonblank historical producer and checker
policies while preserving strict validation and separate grounding.

Add synthetic coverage for citation boundaries, blind classification,
material identity changes, and rejection without ledger mutation.
Correct the request-only citation oracle.
Document exact historical-policy citations and stale evaluator invocation
rejection while preserving prior judgments and attempt history.

Distinguish stale production reuse from authorized regeneration, retaining
unsupported-checkpoint rejection before any overwrite effects.
Cover nested Boolean/number differences, exact values, absent/null
distinctions, pointer escaping, and independent message equality.
Verify payload and evidence-family reporting in both directions.

Validation: 52 presentation tests pass. Also updated docs.
Support all six projection/checkpoint combinations with strict material binding.
Reject exhausted historical failures recovered in the same run.
Preserve valid retry recovery, immutable evidence and schedule-qualified caches.
Reject saved-stage regression, backward request progress, and
later-request attempts before earlier completion.

Add historical chronology regressions and validate compatibility
lifecycles and affected production safeguards.
@tonyzhao6
tonyzhao6 merged commit be5c6a5 into main Sep 24, 2026
5 checks passed
@tonyzhao6
tonyzhao6 deleted the tz6/lp-kg-build-step-30 branch September 24, 2026 16:07
@tonyzhao6
tonyzhao6 restored the tz6/lp-kg-build-step-30 branch September 24, 2026 16:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants