Brummel
13941a24d5
Milestone-close fieldtest for "Runway — real-data ergonomics & honesty hardening". Four curated end-to-end scenarios derived top-down from the milestone promise, run as a downstream consumer against real GER40/EURUSD M1 bars (public interface only; no crates/*/src read): 1. per-instrument pip honesty (#22) — GER40 index pip 1.0 AND EURUSD forex pip 0.0001 both honest end-to-end; AAPL.US/FOOBAR un-vetted refused exit 2, no stdout leak 2. real GER40 M1 open via open_ohlc from aura-ingest ALONE (#80/#81/#92) — no data-server dep, 53173 real bars, C4 O/H/L/C order, ts-window inverse 3. multi-tap ts-join (#93) — two taps at different cadences, 27744 rows, 0 by-ts mismatches; warm-up None rows where a positional zip would corrupt 4. run-registry coherence (#73/#82) — list/rank retired exit 2, families/ family live, two-store Registry read-back + rustdoc Findings: 4 working, 1 friction, 1 spec_gap. - friction: Cell exposes only from_i64/from_f64/... while the side-by-side Scalar is a tagged enum with public I64(..)/F64(..) variants. The natural param-authoring entry point is Scalar (Cell is the hot-path buffer carrier), so the wrong reach is a self-correcting compile snag — ergonomic only. Filed as a follow-up idea. - spec_gap: unknown family id exits 0 empty — ratified into the C18 note in the preceding commit (treat-as-empty contract). Gate verdict: GREEN. All seven axes mapped to a covering scenario and exercised on real bars; both finding classifications and the one material coverage gap were adversarially re-verified. That gap — #22's FX-vetted pip face, untested by the original scenario set — was probed (EURUSD -> sim-optimal(pip_size=0.0001), FX-scaled, not index-mis-scaled) and folded into scenario 1, so the pip promise is demonstrated on both positive faces. Every scenario re-run independently on HEAD before commit.
36 lines
2.3 KiB
Plaintext
36 lines
2.3 KiB
Plaintext
# Runway milestone fieldtest — scenario 4: run-registry coherence (#73/#82)
|
|
#
|
|
# The task: a downstream researcher confirms the dead-end 'runs list'/'rank'
|
|
# surface is RETIRED (clean diagnostic, non-zero exit) while 'runs families'/
|
|
# 'runs family' still work, and the two-store Registry behaviour is discoverable
|
|
# from the public docs.
|
|
#
|
|
# Consumer form: the canonical CLI invocation itself. Built/run via 'cargo run'.
|
|
|
|
## top-level usage (note: no 'runs list', no 'runs rank')
|
|
$ aura
|
|
aura: usage: aura run [--macd] | aura run --real <SYMBOL> [--from <ms>] [--to <ms>] | aura graph | aura sweep [--name <n>] | aura mc [--name <n>] | aura walkforward [--name <n>] | aura runs families | aura runs family <id> [rank <metric>]
|
|
exit=2
|
|
|
|
## RETIRED surface — must refuse
|
|
$ aura runs list
|
|
aura: usage: aura run [--macd] | aura run --real <SYMBOL> [--from <ms>] [--to <ms>] | aura graph | aura sweep [--name <n>] | aura mc [--name <n>] | aura walkforward [--name <n>] | aura runs families | aura runs family <id> [rank <metric>]
|
|
exit=2
|
|
|
|
$ aura runs rank total_pips
|
|
aura: usage: aura run [--macd] | aura run --real <SYMBOL> [--from <ms>] [--to <ms>] | aura graph | aura sweep [--name <n>] | aura mc [--name <n>] | aura walkforward [--name <n>] | aura runs families | aura runs family <id> [rank <metric>]
|
|
exit=2
|
|
|
|
## LIVE surface — must work (after a sweep persisted family 'ft-coherence-0')
|
|
$ aura runs families
|
|
{"family_id":"ft-coherence-0","kind":"Sweep","members":4}
|
|
exit=0
|
|
|
|
$ aura runs family ft-coherence-0 rank total_pips # (first member shown; full list in run output)
|
|
{"manifest":{"commit":"0d185fb4c3d2be3002760dbb9d9a8a2ceed795e0","params":[["signals.trend.fast.length",{"I64":2}],["signals.trend.slow.length",{"I64":4}],["signals.momentum.fast.length",{"I64":2}],["signals.momentum.slow.length",{"I64":4}],["signals.momentum.signal.length",{"I64":3}],["signals.blend.weights[0]",{"F64":1.0}],["signals.blend.weights[1]",{"F64":1.0}],["exposure.scale",{"F64":0.5}]],"window":[1,18],"seed":0,"broker":"sim-optimal(pip_size=0.0001)"},"metrics":{"total_pips":0.26428361277333234,"max_drawdown":0.15423679012344482,"exposure_sign_flips":2}}
|
|
... (3 more members) ... exit=0
|
|
|
|
## edge: a BOGUS family id
|
|
$ aura runs family nope-99
|
|
exit=0 <-- NB: empty output + exit 0, NOT a 'no such family' diagnostic (see findings)
|