fix(runner): restore simple 5-column dataset view + drop stale root schema - #22
Closed
DaveHanns wants to merge 1 commit into
Closed
Conversation
…chema The Console's dataset "Views" tab is driven by actors/runner/.actor/dataset_schema.json. The shape landed in b17cb10 (alongside judgeMode + OTel) tried to project every metric as a dot-path column and split verdicts into a second view. Nice telemetry, but the tab lost its "at-a-glance" property: overallVerdict got demoted from column 1 to column 5, testPrompt and agentOutput were dropped, and the second Verdicts view rendered each check as one opaque JSON blob. This PR replaces .views with a single Eval Results view — the five columns that answer "what happened on this test": Test # | Verdict | Prompt | Agent Output | Checks verdicts is rendered as an inline array (compact list of check objects) rather than a full unwound table. If someone needs per-check drill-down, the raw dataset item is still one click away in the Data tab; the Views tab optimizes for scanning. Also deletes the stale root-level .actor/dataset_schema.json — the pre-flatten copy that survived PR chocholous#13 and confused everyone about which file was live. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
DaveHanns
force-pushed
the
fix/runner-dataset-views-flatten-and-restore-columns
branch
from
July 2, 2026 22:50
ed05fb7 to
cea100c
Compare
DaveHanns
changed the title
DaveHanns
added a commit
that referenced
this pull request
Jul 2, 2026
…chema Rolled into this PR from #22 so the multi-Actor layout + view fix can be tested in a single branch. The Console's dataset "Views" tab is driven by actors/runner/.actor/dataset_schema.json. The shape from b17cb10 (judgeMode + OTel) traded scannability for dot-path metric columns; user feedback was "the previous view was much clearer". Replaces .views with a single Eval Results view — the five columns that answer "what happened on this test": Test # | Verdict | Prompt | Agent Output | Checks verdicts is rendered as an inline array (compact list of check objects) rather than a full unwound table. Per-check drill-down is one click away in the raw Data tab, so the Views tab optimizes for scanning. Also deletes the stale root-level .actor/dataset_schema.json — the pre-flatten copy that survived this PR's restructure. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Collaborator
Author
3 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The Console's dataset "Views" tab is driven by
actors/runner/.actor/dataset_schema.json. The shape from b17cb10 (judgeMode + OTel work) traded scannability for dot-path metric columns; user feedback was "the previous view was much clearer".This PR replaces
.viewswith a singleEval Resultsview — the five columns that answer "what happened on this test":| Test # | Verdict | Prompt | Agent Output | Checks |
verdictsrenders as an inline array (compact list of check objects) rather than a full unwound table — per-check drill-down is one click away in the raw Data tab, so the Views tab optimizes for scanning.Also deletes the stale root-level
.actor/dataset_schema.json— the pre-flatten copy that survived PR #13.Test plan
jq . actors/runner/.actor/dataset_schema.jsonparsesjq .views | keys=["results"](single view)testIndex, overallVerdict, testPrompt, agentOutput, verdictsverdicts.format = "array"