claude
9124275bf3
Binary-only milestone fieldtest for milestone 36 (self-description): a
fieldtester agent bootstrapped from the release binary (d26f0c8) alone —
no engine sources, no repo docs, no bootstrap card — and drove five
end-to-end scenarios: cold bootstrap -> author -> validate (green,
synthetic + real EURUSD, 3944 trades), execution semantics +
latch/edge-pulse idiom (green), vocabulary breadth (33 nodes / 7 folds /
17 metrics / 6+6 blocks, every entry with a meaning), document ramp from
a bare {} (green, 3 members), trace/measurement path (dead-ends,
tracked).
Verdict: the bootstrap card (#267, closed as superseded) is empirically
redundant for the bootstrap->author->validate spine. Two seams keep the
promise short of end-to-end, both tracked outside M1: the declared-tap
drop on the registration path (#327, the missing mechanism of #312/M6)
and the sugar<->document axis namespace (#328, prerequisite of the #319
retirement). Friction routed: #329 #330 #331; evidence comments on #312
and #324. Milestone 36 closed with this adjudication; the fieldtest spec
remains the usual git-ignored working file.
refs #267, refs #312, refs #319
2.1 KiB
2.1 KiB
s5 — trace / measurement path
Protected property: from the surfaces a consumer can discover which verbs persist per-cycle traces and reach a signal-quality measurement — the milestone's own headline being "signal quality is measured in R".
What the surfaces say
aura --help: "Traces: sweep --real --trace / walkforward --real --trace
record per-cycle taps under runs/, consumed by aura chart and aura measure."
aura measure ic --help: "Information Coefficient of a signal tap against
forward returns of a price tap" — requires --signal <SIGNAL> and
--price <PRICE>.
What actually happens
- Discovery works:
runs familieslists the traced families;measure ic's<RUN>is the member path relative toruns/traces/(<family>/<instr-window>/<param-combo>); the missing-tap error is clear and lists available taps.measure icruns green on the persisted taps. - Dead-end for the intended inputs. The only taps any surface-reachable verb
persists are the closed presentation set
equity/exposure/r_equity(net_r_equity) — execution-side R/pip curves, not the strategy's bias signal nor the instrument price. Someasure iccan only be fed, e.g.,--signal exposure --price equity, which is not a signal-vs-price IC at all (result ≈ noise, 0.0019). - Declared taps are silently dropped.
graph build --helpdocuments the optapas "declare a recordable tap on a wire".tapped.oplist.json(this dir) declarestap bias.bias as signalandtap fast.value as price, yet aftersweep --real --tracethe persisted set is still["equity","exposure", "r_equity"]; bothmeasure ic --signal signalandchart --tap signalreport the tap does not exist. There is no surface-documented path to persist a genuine signal or price tap, someasure ic's stated contract is unreachable end-to-end.
Evidence (verbatim)
$ aura measure ic --signal signal --price price <tapped-run>
aura: run '…' has no tap 'signal' (taps: ["equity", "exposure", "r_equity"])
$ aura chart 010f8afa-0 --tap signal
aura: no family member has a tap named 'signal' (exit 0)