Skip to content

docs: Document OpenAI review validation matrix #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
idy wants to merge 2 commits into from
Closed

docs: Document OpenAI review validation matrix #13

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
97a3466
repo: document OpenAI review validation matrix
idy Jul 30, 2026
20ae0d9
repo: clarify review evidence invalidation
idy Jul 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -161,6 +161,29 @@ second workflow.

## Rollout

### Live validation matrix

Use this matrix after the caller is present on the repository's default branch.
Every run recreates the three fixed Checks on the exact current PR head; the
stage modes below describe model work and evidence reuse inside that run.

| Trigger | PR evidence | Issue evidence | Code evidence | Expected Check publication |
| --- | --- | --- | --- | --- |
| Open a ready PR | `full` | `full` for every linked Issue | `full` complete diff | All three fixed Checks |
| Edit only the PR body | `incremental` field diff | `reused` | `reused` | All three, with only PR metadata re-reviewed |
| Edit one linked Issue | `reused` | `incremental` for that Issue; others `reused` | `incremental` plan-conformance aggregation with no repeated complete code diff | All three, with Issue and Code verdicts revalidated |
| Push a descendant commit | `reused` | `reused` | `incremental` from the last completed head | All three on the new head |
| Rerun an unchanged head | deterministic checks plus `reused` | `reused` | `reused` | All three with zero model tokens |

An Issue edit revalidates plan conformance without resending an unchanged
complete code diff. A workflow-source, runtime, model, or trusted-policy change
intentionally invalidates incompatible session evidence and safely starts the
affected review stages again.

When editing PR metadata, preserve the native closing-Issue relationship.
Removing or changing that relationship changes the plan-conformance identity
and intentionally invalidates the affected Code evidence.

1. Copy `openai-pr-review-dispatch.yml` into the caller repository's default
branch.
2. Replace local reusable-workflow paths with a protected `v1` reference or an
Expand Down
Loading