Index and compare manifests and metrics across a sweep family #33

Closed
opened 2026-06-05 23:40:24 +02:00 by Brummel · 0 comments
Owner

Part of milestone "The World — parameter-space & sweep" (cycle D). Depends on cycle C (#32) — the param-sweep producing a family of runs.

Each run already emits a manifest + metrics (since cycle 0009). C18 (docs/design/INDEX.md) calls for a run registry: "one record per run = a manifest (node-commit + params + data-window + seed + broker profile) + metrics, queryable, with lineage". Determinism (C1/C12) makes a run reproducible from its small manifest, so the registry stores manifests + metrics and re-derives full results on demand.

This cycle indexes the sweep family's manifests + metrics into a queryable registry and supports comparison across the family — the substance of the research loop (comparing experiments over time, which has no home in git or Gitea). Depth target per C18 is structured (promotion/status, lineage, run-diff); the first cut may land a narrower slice.

Ledger refs: C1, C12, C18 (docs/design/INDEX.md).

Part of milestone "The World — parameter-space & sweep" (cycle D). Depends on cycle C (#32) — the param-sweep producing a family of runs. Each run already emits a manifest + metrics (since cycle 0009). C18 (docs/design/INDEX.md) calls for a run registry: "one record per run = a manifest (node-commit + params + data-window + seed + broker profile) + metrics, queryable, with lineage". Determinism (C1/C12) makes a run reproducible from its small manifest, so the registry stores manifests + metrics and re-derives full results on demand. This cycle indexes the sweep family's manifests + metrics into a queryable registry and supports comparison across the family — the substance of the research loop (comparing experiments over time, which has no home in git or Gitea). Depth target per C18 is structured (promotion/status, lineage, run-diff); the first cut may land a narrower slice. Ledger refs: C1, C12, C18 (docs/design/INDEX.md).
Brummel added this to the The World — parameter-space & sweep milestone 2026-06-05 23:40:24 +02:00
Brummel added the feature label 2026-06-05 23:40:24 +02:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Brummel/Aura#33