Skip to content

docs(rtl): propose audit evidence lifecycle - #6044

Closed
cixzhang wants to merge 1 commit into
mainfrom
docs/rtl-audit-evidence
Closed

docs(rtl): propose audit evidence lifecycle#6044
cixzhang wants to merge 1 commit into
mainfrom
docs/rtl-audit-evidence

Conversation

@cixzhang

@cixzhang cixzhang commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Why

Recent RTL audit work split across #5864, #5885, #5988, and #5858 is relying on an evidence policy that has not yet been recorded or owner-approved. This draft gives those changes one architecture target to review instead of letting each PR define a different meaning for measured, verified-N/A, and inherited coverage debt.

Proposed direction

  • compute one live state per component (measured, verified-na, coverage-gap, or stale/known variants)
  • pin verified-N/A claims to source/helper/story evidence digests and fail closed on drift
  • admit the existing 204-component gap only as a visible, non-failing, removal-only baseline
  • fail new gaps, stale declarations, stale baseline rows, and any attempt to grow the baseline
  • keep D1 applicability exceptions separate from curated positive targets

This is intentionally authority: draft. It proposes policy; it does not authorize the open implementation PRs or change CI/runtime behavior.

Owner decision still required

unknown/* registry entries have no canonical component directory to hash. Before this record can become current, an owner must choose whether those entries are eligible for verified-na, and if so which source/story files constitute their evidence.

Validation

  • pnpm check:knowledge
  • pnpm check:repo
  • Prettier
  • public-repository leak guard
  • git diff --check

No Changeset: proposed architecture documentation only.

Do not merge until the owner decision is recorded and the exact draft head is approved.

Documents the target design for the RTL audit's per-component
states, verified-N/A evidence closure (SHA-256 pinned source/helper/
story digests, fail-closed on drift), and a removal-only baseline for
the pre-existing coverage-gap debt so a full sweep can fail on new or
stale findings without being permanently red on inherited ones.

authority: draft, pending owner approval. Flags one open question:
how an `unknown/*` registry entry (no canonical source directory)
fits the evidence-closure model.

No runtime or audit-script changes; this is documentation only.
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Meta Open Source bot. label Sep 4, 2026
@vercel

vercel Bot commented Sep 4, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
astryx Ready Ready Preview Sep 4, 2026 7:42pm UTC

Request Review

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

PR Analysis Report

Preview availability: Storybook and Sandbox were not published for this CI run.

No new or modified components detected.

Bundle Size Summary

No component packages changed.

Accessibility Audit

Status: No accessibility violations detected.


Generated by PR Enrichment workflow | View full report

@cixzhang

cixzhang commented Sep 5, 2026

Copy link
Copy Markdown
Contributor Author

Closing this duplicate in favor of #6046, which is now the canonical draft for architecture:rtl-audit-evidence. Please continue specification review and revisions there.

@cixzhang cixzhang closed this Sep 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant