feat(bench): CLI driver, fixed-cost surface, committed baselines + docs

Tasks 7-8 of the bench-harness plan plus the orchestrator's sizing pass —
this completes the phase-1 harness (closes #251).

Driver: run [--surface|--quick|--reps|--out] / pin over five surfaces,
report-only comparison (drift NOTICE at >=10%, never a failure), fingerprint
mismatch exits 1 with a baseline-vs-measured block, infra errors exit 2,
debug builds refuse to measure. The Bench project-facts line and the crate
README (discipline: quiet box, warmup+median, deliberate re-pins) land with
it.

Workload sizing, measured then corrected: the release engine outran the
plan's guesses by ~100x, leaving sub-second child walls where spawn jitter
reaches the 10% threshold and flaps the report. Full-size workloads now land
in whole seconds — engine 10M bars (~0.7s), ingest 24 months x 20 fresh
drains (~0.4s), campaigns on a 24-month archive with a ~22-month window and
a 5x5 member grid (sweep ~1.4s, heavy ~5.5s), fixed-cost as in-rep medians
over spawn batches (20x help, 10x run). Quick mode keeps the small
E2E-fixture shape.

The campaign fingerprint folds all three realization layers — sweep winner,
gate survivor ordinals, bootstrap trade counts (pooled or per-survivor sum)
— so a wrong-result regression in any stage fails the bench, not just a
wrong sweep winner. Baselines pinned on this host (commit-stamped), verified
by a follow-up run: five fingerprints OK at <=2% drift under load.

Verification: cargo test --workspace 1379 green (bench tests all quick-mode;
the release-binary E2Es are #[ignore]d behind -- --ignored per the
suite-wallclock discipline), clippy -D warnings clean, doc build clean.

This commit is contained in:

Claude

2026-07-17 15:38:46 +02:00

parent 3a25a4ccba

commit 400105e2e2

18 changed files with 782 additions and 82 deletions

									
										CLAUDE.md
									
		+2
		
												View File
												
				@@ -178,6 +178,8 @@ Everything else is a fixed convention (see `~/dev/skills/docs/conventions.md`).

				- **Test** — `cargo test --workspace`

				- **Lint** — `cargo clippy --workspace --all-targets -- -D warnings`

				- **Doc build** — `cargo doc --workspace --no-deps 2>&1`

				- **Bench** — `cargo run --release -p aura-bench -- run` (cycle close;

				  report-only — see `crates/aura-bench/README.md`)

				- **Design ledger** — `docs/design/INDEX.md`

				- **Glossary** — `docs/glossary.md`

				- **Issue tracker** — Gitea, repo `Brummel/Aura`: