test(mcp): pin official 2026-07-28 conformance baseline - #1808
test(mcp): pin official 2026-07-28 conformance baseline#1808groupthinking with Copilot wants to merge 3 commits into
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Co-authored-by: groupthinking <154503486+groupthinking@users.noreply.github.com>
Co-authored-by: groupthinking <154503486+groupthinking@users.noreply.github.com>
| npm_version = _run(["npm", "--version"]).stdout.strip() | ||
| package_json = json.loads((REPO_ROOT / "package.json").read_text()) | ||
|
|
||
| overall_ok = all(record["summary"]["ok"] for record in run_records if record["required"]) |
Strategic compatibility receipt — 2026-09-09 — WATCHNew primary evidence: MCP merged the Filesystems Working Group charter on 2026-09-08, commit aa8ce049. The charter itself was initially authored August 24. VERIFIED: the WG plans a Resources write extension (create/update/delete/stat), optimistic concurrency/create-if-absent, and notification/cache interaction. The deliverable is explicitly Ideating. This is not an accepted write-method contract, SDK release, or evidence of production enterprise adoption. The charter excludes a parallel files/* primitive, host sandbox/local-disk semantics, and application write-authorization policy. Interpretation for #1661 / Agent Factory: retain an adapter boundary for future resource writes and durable receipts, while preserving independent authorization, origin isolation, conflict handling and replay protection. Do not implement guessed wire methods or label this fixture baseline as conformance for future writes. Queued acceptance gate: only add write fixtures after an accepted, pinned Extensions Track SEP and supported SDK contract; require negative tests for lost updates, create-if-absent conflicts, cross-origin writes, revocation and stale notifications. Existing pinned baseline remains unchanged. Fixtures certify their tested contract, not the deployed MCP surfaces. Action: attached this dated scope/acceptance note to the existing conformance PR; no new competing issue or runtime activation. Follow-up effort: 1–2 hours for contract review when the SEP advances. Current Copilot-head CI reports action_required, not passed. |
Canonical issue
Outcome
Adds a pinned, local-only official MCP conformance baseline for the
2026-07-28wire. The baseline certifies the implemented fixture surfaces, fails closed on required warnings/failures, preserves bare-origin PRMresourcevalues exactly through authorization and token exchange, and writes a machine-readable receipt for audit and CI use.Scope
Included:
a983ba93c91e0bb31d0b6849eeb52f0ad1083107tests/fixtures/mcp_conformance/official-2026-07-28-receipt.jsontools/list,tools/call, initialize/notification behavior, and OAuth metadata/token flowsresourceidentifier byte-for-byte instead of normalizing a bare origintools/listorder across three consecutive probesExplicitly excluded:
Risk
Verification
Checks run on head
edfbc7b31b534e60001eda6369edd2e2f180664d.pytest tests/unit/test_official_mcp_conformance.py --no-cov -qpython scripts/testing/official_mcp_conformance.py"overall_ok": truewith empty requiredwarnings/failuresProduction evidence
Not applicable. This PR adds a local-only conformance harness, fixture endpoints, and receipt generation; it does not change a production runtime path or deployment target.
Agent handoff