Skip to content

Document ThinkingBox-Bench result aggregation - #13

Closed
Liang-Chun Tsai (ltsai-dev) wants to merge 11 commits into
mainfrom
ltsai-microsoft-document-thinkingbox-bench-release
Closed

Document ThinkingBox-Bench result aggregation#13
Liang-Chun Tsai (ltsai-dev) wants to merge 11 commits into
mainfrom
ltsai-microsoft-document-thinkingbox-bench-release

Conversation

@ltsai-dev

Copy link
Copy Markdown
Contributor

Summary

  • add a concise result-analysis section to the ThinkingBox-Bench v1.0 release README
  • show the tb agg command for the benchmark JSONL
  • explain when pass@1, pass@20, and pass^20 are reported

This is a follow-up to the already-merged benchmark release documentation PR.

Liang-Chun Tsai and others added 11 commits August 17, 2026 11:02
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: f71fc0b5-25dc-43ae-8eea-04d0e45f8de9
@ltsai-dev

Copy link
Copy Markdown
Contributor Author

Superseded by #14, which was created from the latest main branch with a clean one-file diff.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant