Skip to content

Compare runs in columns, each column a workspace and a run, with the table toolkit's controls #206

Description

@harenome

Priority

medium. The change is in the web layer. It changes the Compare routes and templates, adds a JSON route for a workspace's runs, and changes the table toolkit that other tables share. In the backend, one parser accepts an empty column.

Components

  • app/nullius (backend)
  • app/web (routes)
  • templates and static files
  • docs and the site
  • catalogue (benchmarks, agents, capabilities)
  • the standard (ports, kits, relay, runs)
  • CI, workflows and skills

Today

  • Compare needs two runs. With fewer, it shows a separate picker page (/compare/pick) with two steps: a Left and a Right workspace, then a Left and a Right run. To add a third run, you go back to All runs and tick it there.
  • Each column header shows the agent, the job id and the workspace name with no label. The table has no Benchmark row.
  • A sharded run is a column per shard. A Runs page job= link of one shard compares that shard only.
  • The cohort switch sits above the page with a box of explanation under it. A "Side by side" heading, a row of "Order columns:" buttons and a "Task by task" heading with an explanation line follow. Both tables are on one page, one under the other.
  • No number shows its difference from another column.
  • The table header does not stay in view when the page scrolls. A long table loses the names of its columns.
  • In the table toolkit's controls row, buttons, text buttons and filter pills have different heights.

Wanted

  • Compare opens with two columns. With one run or none, an empty column waits beside the run.
  • Workspace and Run are the first two rows of the table, labelled in the left column as the metrics are. Each column picks a workspace, then a run, from a searchable dropdown. A list opens only on its button, or after a workspace change.
  • A run that another column holds is greyed in the lists. A sharded run is one column, with a link to each shard.
  • A Benchmark row above Dataset.
  • The first column is the baseline. Each summary number of the other columns shows its difference from the baseline, in the row's unit.
  • Each column has Move left, Move right and Remove. Add a run adds an empty column.
  • The table toolkit's controls row heads the table. Its views are the cohort toggle, a Side by side / Task by task toggle and an Order menu. Its action is Add a run. One view shows at a time. Every link keeps the view and the cohort.
  • Task by task has the same column controls.
  • The explanation box, the "Side by side" heading and the Task by task explanation line go. The warnings that ask for an action stay: no shared cohort, and datasets that differ.
  • In the table toolkit, rows with data-sticky stay in view under the controls row while the page scrolls, until the table ends. Every control in the controls row has one height.

Acceptance

  • /compare with no run or one run shows two columns. An empty column of two has no Remove.
  • Workspace and Run are rows of the table, one cell for each column.
  • A column's run list is searchable, newest launch first, the baseline's dataset first, checks marked. It does not open on load or after Add a run.
  • A workspace picked lists its runs in place (/compare/runs). A run picked opens the comparison with that run in its column.
  • A run that another column holds is greyed in a list, with a tooltip that names the column. A click or Enter on it does nothing.
  • A sharded run is one column with its trials from every shard and a link to each shard. A shard's id on a pick= or job= link stands for its whole run.
  • The table has a Benchmark row above Dataset, with a dash when the catalogue does not know the dataset.
  • Each summary number of columns 2 to N shows its difference from the first column, in the row's unit. The row's direction sets its colour. A check has no colour.
  • Move left, Move right, Remove and Add a run are links that keep the cohort and the view.
  • The controls row holds the cohort toggle, the view toggle, an Order menu with the i-reorder icon, and Add a run. The Order menu holds Group by agent and Alternate agents.
  • ?view=tasks shows only the task table, with the same column controls. Side by side has no parameter.
  • The explanation box, the "Side by side" heading and the Task by task explanation line are gone. The no-shared-cohort warning and the datasets warning show in both views.
  • /compare/pick redirects to /compare with its picks.
  • A table's <tr data-sticky> rows stay under its controls row while the page scrolls, until the table ends. data-sticky="wide" rows do this only from 900 px wide.
  • The controls in a table's controls row have one height (--tool-h).
  • The field guide and the results guide describe the columns, the baseline and its difference.

Dependencies and related

Activity

  1. added
    enhancementNew feature or request
    P2Planned: limited in scope, has a way around it, or a missing feature
    on Nov 18, 2026
  2. added theissue type on Nov 18, 2026
  3. added a commit that references this issue on Nov 19, 2026
    be36d38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Planned: limited in scope, has a way around it, or a missing featureenhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions