Skip to content

fix(docs): repair garbled model-board note in benchmark dataset - #1089

Merged
Aditya-thesys merged 1 commit into
mainfrom
fix/benchmark-agent-note
Aug 26, 2026
Merged

fix(docs): repair garbled model-board note in benchmark dataset#1089
Aditya-thesys merged 1 commit into
mainfrom
fix/benchmark-agent-note

Conversation

@Aditya-thesys

Copy link
Copy Markdown
Contributor

provenance.model_board.note in the benchmark agent dataset carried a corrupted fragment — ...for independent rescoring.11 regime and still lack per-row evidence and pricing links. Do not treat current-main results as row-identical evidence for this board. — left over from removing a 0.2.11 scorer reference. It shipped verbatim in /benchmarks/data.json, so agents ingesting the dataset got a broken sentence.

Trimmed to a clean sentence: the model-board rows are summaries; raw generations and per-run verdicts are committed in the benchmark repo for independent rescoring.

One-line change; no numbers affected.

The provenance.model_board.note in the benchmark agent dataset carried a
corrupted fragment ('...for independent rescoring.11 regime and still lack
per-row evidence...') left over from removing a 0.2.11 scorer reference. It
shipped verbatim in /benchmarks/data.json. Trim it to a clean sentence.
@vercel

vercel Bot commented Aug 26, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
openui-docs Ready Ready Preview Aug 26, 2026 1:28pm

Request Review

@Aditya-thesys
Aditya-thesys merged commit 78913a1 into main Aug 26, 2026
4 checks passed
@Aditya-thesys
Aditya-thesys deleted the fix/benchmark-agent-note branch August 26, 2026 13:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants