Repository navigation
Conversation
This was referenced Oct 26, 2026
Collaborator
Author
|
The review dataset exercises the adapters with a real historical co-training SQLite store and retained frozen-Blue evaluations. Both co-training executions remain distinct, with unknown trial and retry relationships. The frozen-study inventory records 9 expected trial cells, 0 missing cells and 4 unresolved exclusions. Included attempts and evaluations are not counted as additional replicates. The archive includes the historical store, raw evaluations and verification commands. Its frozen-study inventory is derived; excluded original source archives prevent replaying the full original source-validated collation. |
PaulHax
force-pushed
the
experiment-records
branch
from
October 29, 2026 01:23
854c068 to
3dba0fb
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Comparison membership needs explicit scientific identities
A recipe or run name cannot identify a replicate, establish a retry relationship or select comparable evidence.
Save validated records and explicit selections
Add versioned protocols, attempts, artifacts and evaluations with relationship checks, sourced unknowns, budgets and metric definitions. Collation selects named attempts and evaluations and retains included, excluded and missing cells in an immutable content-identified snapshot. Read-only frozen-defender and co-training adapters preserve unresolved historical membership; study-specific rules establish comparability.
The frozen analyzer verifies the saved configuration and analyzer/helper identity and retains its source with the report.
Part of #29, #31 and #33. Based on #34.