Skip to content

Explorers: saved views, chart size, hidden unselected methods, a win-rate title and renames - #688

Merged
Innixma merged 1 commit into
mainfrom
explorers-saved-views
Oct 26, 2026
Merged

Innixma merged 1 commit into
mainfrom
explorers-saved-views

Conversation

@Innixma

@Innixma Innixma commented Oct 26, 2026

Copy link
Copy Markdown
Collaborator

Summary

The explorers get more figure controls: the Pareto and tuning-trajectories explorers take a typed chart width and height and can hide the unselected methods instead of greying them out, and the win-rate explorer gets an editable figure title drawn in the matrix and renames models from their chips. Every one of them can save its current view as a new, still editable page. generate_all_figs also writes an overall tuning-trajectories explorer with a subset selector, and leaves out by default the static figures an explorer already shows and exports.

Details

Pareto and tuning-trajectories explorers:

  • "Chart size" sets the chart's width and height in pixels; an empty box takes the automatic size (the panel's width, 400 tall), shown as its placeholder, and a size below the minimum is not used and is outlined dashed. The size holds on every subset and view. The legend strip wraps to a typed width, so the SVG / PDF / PNG exports are as narrow as the chart.
  • "Hide unselected" draws only the selected methods (points, connectors and hover targets) instead of greying the rest out, and the dashed front then joins the shown points. The automatic axis limits stay those of every point, so they hold still while methods are toggled. build_pareto_explorer_html(hide_unselected=True) opens a page that way.

Win-rate explorer:

  • A "Title" box edits a figure title drawn above the column labels, so paper view and the exports carry it. The reporter opens each subset's page on the subset's name, as the Pareto pages are.
  • Models are renamed from their chips as on the Pareto explorer (Enter or leaving the box applies, Escape cancels, an empty name restores, "Reset names" undoes all). A rename covers every variant of the model and keeps the variant tag. build_winrate_explorer_html(method_names=...) presets names.

Saved views:

  • "Save view" downloads the page as it loaded (a copy of the document taken before any script changed it, so without the theme stamp or the drawn chart) with the current view written into a <script type="application/json" id="saved-view"> block; the page applies a saved view before its first render, so the file opens on that view and stays fully editable, and saving it again replaces the block.
  • The Pareto and tuning-trajectories pages save the subset and axes, the selection (or following the front), the hide toggle, and the titles, limits, size and names typed on the page; the win-rate page saves the models and variants shown, one per model or not, the order and size, the title and the names. Parts a page cannot use (a subset or method it does not have) are dropped.

generate_all_figs:

  • save_composite_trajectories_explorer (on whenever plot_tuning_trajectories is) writes <output_dir>/tuning_trajectories_explorer.html from the subsets' tuning_trajectories/tuning_trajectories.csv, as the composite Pareto explorer is built from their pareto_front_points.csv.
  • static_figures defaults to "uncovered", which skips the static figures an explorer shows and exports: each subset's four pareto_front_* figures, its win-rate matrix figure, and the nine tuning-trajectory figures of Improvability or Elo against train, inference or total time. "all" writes them too. Figures without an interactive page (the tuning-impact bar plots, the composite leaderboard, the trajectory diagnostics such as baseline advantage, metric error and validation against test) are written either way. LeaderboardReporter.eval and the tuning-trajectory functions take the same argument with "all" as the default, so direct callers are unchanged. On a 14-subset run with trajectories the default writes 238 figures instead of 434.

Tests

  • ruff check . && ruff format --check . (ruff 0.14.0)
  • pytest tests/tabarena/contexts tests/tabarena/plot tests/tabarena/evaluation tests/tabarena/website -q: 399 passed, with the new test_a_view_is_saved_into_a_copy_of_the_page_as_it_loaded, test_the_chart_size_is_typed_for_the_page, test_unselected_methods_can_be_hidden, test_the_figure_title_is_drawn_in_the_matrix_and_edited, test_models_are_renamed_for_display_only (win-rate), test_the_composite_trajectories_explorer_holds_every_subset, test_static_figures_reach_the_compare_and_trajectory_passes, test_without_static_figures_only_the_explorer_pages_are_written and test_uncovered_static_figures_leave_out_the_explorer_views.
  • Driven in headless Chromium on the pages of a generate_all_figs run:
    • Composite Pareto explorer: a typed 600 x 300 chart draws at 600 x 330 with its title row, the legend wraps to 600 px and the SVG export is 620 px wide; a width below the minimum is flagged and unused; the size holds on another subset; with two methods selected, "Hide unselected" draws marks and hover targets for those two only.
    • "Save view" after picking a subset, methods, the hide toggle, a title, a size and a rename (with markup): the downloaded file reopens on all of them, stays editable, saves again with its view replaced, and carries no theme stamp.
    • Composite tuning-trajectories explorer: 14 subsets on the selector, switching redraws, and a saved view reopens on its subset.
    • Win-rate explorer: opens titled with the subset, a typed title is drawn, a renamed model shows in the matrix, a saved view reopens with its title, order and names, and "Reset names" restores the model.
    • No page errors.

🤖 Generated with Claude Code

https://claude.ai/code/session_01ELdutHiUqkvynzEP7EnPsi

…rate title and renames

The Pareto and tuning-trajectories explorers take a typed chart width and height, and can hide the unselected methods
instead of greying them out. The win-rate explorer gets an editable figure title drawn in the matrix (opening on the
subset's name) and renames models from their chips. Each of them has a "Save view" button that downloads the page
opening on the current view, still editable. `generate_all_figs` also writes an overall tuning-trajectories explorer
with a subset selector, next to the composite Pareto explorer.

`generate_all_figs(static_figures=...)` defaults to "uncovered": the static figures an explorer shows and exports (the
four `pareto_front_*` figures, the win-rate matrix figure, and the tuning-trajectory figures of Improvability or Elo
against train, inference or total time) are written only with "all".

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01ELdutHiUqkvynzEP7EnPsi
@Innixma
Innixma merged commit 83bc895 into main Oct 26, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant