spec: 0090 blueprint forward-compat two-tier discipline (boss-signed)

Iteration within the C24 topology-as-data milestone (#156). Codifies the
blueprint format's additive forward-compatibility under one discipline:
Tier-1 (additive-optional) = serde-default silent-ignore, no version bump,
C1 default-equals-prior-behaviour; Tier-2 (must-understand: new node type,
edge semantics, structural-axis kind) = bump format_version so an old reader
refuses cleanly rather than building a different graph.

Most of #156 already shipped with #155 (cycle 0087): the format_version
envelope, omit-defaults canonical form, and both Tier-2 load-path refusals
(LoadError::UnsupportedVersion / UnknownNodeType) are present and green.
The genuine remainder is one unproven property — forward-tolerance of an
unknown optional field on the current loader — plus codifying the discipline
in the LoadError doc and the C24 ledger entry. Not a new mechanism.

Derived fork recorded on #156: the per-section required-flag mechanism (PNG
critical-vs-ancillary) is NOT built — the version envelope already gives the
must-understand refusal at version granularity, there is no current Tier-2
section to validate a finer scheme against, and C1 holds either way.

Boss-signed on a grounding-check PASS (all current-behaviour claims ratified
by named green tests; the new Tier-1 pin correctly absent — this cycle's
deliverable). refs #156
This commit is contained in:
2026-06-30 13:11:39 +02:00
parent 3c4b667955
commit cb558519b0
+204
View File
@@ -0,0 +1,204 @@
# Blueprint format forward-compatibility: the two-tier discipline — Design Spec
**Date:** 2026-06-30
**Status:** Draft — awaiting user spec review
**Authors:** orchestrator + Claude
## Goal
Close #156: guarantee the blueprint data format (C24) extends **additively**
later additions land without breaking existing serializations — under a single,
codified two-tier discipline:
- **Tier-1 (additive-optional, ignore / default-safe).** A new optional field or
section is tolerated by an older reader: serde ignores unknown fields (no
`deny_unknown_fields` anywhere — verified `rg = 0`), `skip_serializing_if`
omits absent options, and **no `format_version` bump** occurs. Constraint (C1):
a new optional field's default equals prior behaviour, so an old blueprint
loaded by a new engine reproduces the **same** graph.
- **Tier-2 (load-bearing, must-understand).** A new node type, edge semantics, or
structural-axis kind **must bump `format_version`**, so an old reader refuses
cleanly (`LoadError::UnsupportedVersion`) rather than silently building a
different graph. An out-of-vocabulary node likewise refuses
(`LoadError::UnknownNodeType`).
Most of #156 already shipped with #155 (cycle 0087). This cycle is a small
**verification-plus-codification** iteration: it adds the **one** missing proof —
forward-tolerance of an unknown optional field on the current loader — and writes
the discipline durably into the `LoadError` doc and the C24 ledger entry. It is
**not** a new mechanism.
### What #155 already delivers (verified, green — the grounding evidence)
- The `format_version` envelope: `BLUEPRINT_FORMAT_VERSION = 1`, `BlueprintDoc {
format_version, blueprint }` (`blueprint_serde.rs:17-24`).
- Canonical omit-defaults form: `#[serde(default, skip_serializing_if = ...)]` on
`CompositeData::{edges,input_roles,output}` and `PrimitiveData::{name,bound}`.
Pinned by `signal_serializes_to_canonical_golden`.
- **Both Tier-2 refusals at the load path**, each with a green test:
- `LoadError::UnsupportedVersion { found, supported }` —
`blueprint_serde.rs:162-167`, test `unsupported_version_fails_named`
(`format_version: 2` → refused).
- `LoadError::UnknownNodeType(String)` — `blueprint_serde.rs:128`, test
`unknown_node_type_fails_named` (`"NoSuchNode"` → refused).
There is **no CLI `load-a-blueprint-JSON` command** today; the version-refusal has
no CLI surface, so the engine-level typed `LoadError` **is** the Tier-2 contract.
The CLI *build* path (`aura graph build`) already exit-codes an unknown node type
via `OpError` (cycle 0088). This cycle adds no CLI surface.
## Architecture
The forward-compat guarantee is a **property of the existing serde projection**,
not a new component. Tier-1 tolerance is already true (serde's default
unknown-field handling + the omit-defaults discipline); it is simply **unproven**.
The deliverable is therefore:
1. one **executable proof** (the Tier-1 forward-tolerance test), and
2. a **documentation codification** turning the currently-deferred
"must-understand horizon … is #156" note into the settled two-tier rule.
No struct, signature, or runtime behaviour changes. The derived design fork (the
per-section required-flag / PNG critical-vs-ancillary mechanism) is **not built**
— recorded on #156 with its rationale: the version envelope already gives the
must-understand refusal at version granularity, there is no current Tier-2 section
to validate a finer scheme against, and C1 holds either way.
## Concrete code shapes
### The deliverable: the Tier-1 forward-tolerance test (new — the additive property as executable evidence)
Added to the `blueprint_serde.rs` test module (it already has `run_recording`,
`sink_free_sma_cross_signal`, and `std_vocabulary` in scope):
```rust
#[test]
fn unknown_optional_field_is_tolerated_byte_identically() {
// Forward-compat (C24 / #156, Tier-1): a future writer that has additively
// extended the format emits optional keys the CURRENT loader does not know.
// The loader must silently ignore them and reconstruct the IDENTICAL graph —
// never refuse, never let an unknown key leak into the built blueprint. serde
// ignores unknown fields by default (no deny_unknown_fields). This pins the
// additive property the canonical-golden + omit-defaults discipline claims but
// no existing test exercises.
let canonical =
blueprint_to_json(&crate::test_fixtures::sink_free_sma_cross_signal()).expect("serializes");
// Inject unknown optional keys at two additive shapes a new writer might emit:
// a doc-level section ("metadata") and a per-primitive key ("annotations").
let with_unknown = canonical
.replacen(
r#"{"format_version":1,"#,
r#"{"format_version":1,"metadata":{"author":"future"},"#,
1,
)
.replacen(r#"{"type":"Sub"}"#, r#"{"type":"Sub","annotations":["future"]}"#, 1);
assert_ne!(with_unknown, canonical, "probe must actually inject unknown keys");
// tolerated, not refused
let loaded = blueprint_from_json(&with_unknown, &|t| aura_std::std_vocabulary(t))
.expect("an unknown optional field is tolerated, not refused");
// the unknown keys did not leak into the graph: re-serialization equals the
// canonical form WITHOUT them (byte-identical reconstruction).
assert_eq!(blueprint_to_json(&loaded).expect("re-serializes"), canonical);
// and the loaded graph runs bit-identically to the plain canonical one (C1).
let plain = blueprint_from_json(&canonical, &|t| aura_std::std_vocabulary(t)).expect("loads");
assert_eq!(
run_recording(loaded),
run_recording(plain),
"run diverged under an unknown optional field",
);
}
```
### The codification: `LoadError::UnsupportedVersion` doc (before → after)
Before (`blueprint_serde.rs:110-113`):
```rust
/// `format_version` the loader does not understand. The full must-understand
/// horizon (multiple versions, unknown-section policy) is #156; #155 supports
/// exactly one version and refuses any other, cleanly.
UnsupportedVersion { found: u32, supported: u32 },
```
After (the discipline is now settled, not deferred):
```rust
/// `format_version` the loader does not understand — the **Tier-2
/// (must-understand)** refusal. The format extends under a two-tier discipline
/// (#156): a **Tier-1** additive-optional change (a new optional field /
/// section) does NOT bump the version — an older reader tolerates it (serde
/// ignores unknown fields; see `unknown_optional_field_is_tolerated_byte_identically`)
/// and, by C1, a new optional field defaults to prior behaviour. A **Tier-2**
/// load-bearing change (a new node type, edge semantics, or structural-axis
/// kind) MUST bump `BLUEPRINT_FORMAT_VERSION`, so an old reader refuses here
/// rather than silently building a different graph (C1 / C18). The
/// per-section required-flag scheme is deferred until a real sub-version Tier-2
/// addition needs finer granularity than a version bump.
UnsupportedVersion { found: u32, supported: u32 },
```
(The `BLUEPRINT_FORMAT_VERSION` doc at `:15-17` already states "Bumped only by a
load-bearing (Tier-2) change; additive optional fields do not bump it (#156)" and
needs no change — it is consistent with the settled discipline.)
### The codification: C24 ledger Status block (before → after, shape only)
The C24 entry's `**Remaining**` list (`INDEX.md:1823-1827`) names "the
forward-compat *must-understand* gate (#156)". This cycle moves #156 out of
Remaining into a shipped note stating the two-tier discipline and the proof test.
Exact prose is the planner's; the shape: drop #156 from Remaining, add one
sentence to Status that the forward-compat discipline is codified (Tier-1
serde-default tolerance proven; Tier-2 = version/vocabulary refusal, already
green) — leaving #158 and #159 in Remaining.
## Components
- `crates/aura-engine/src/blueprint_serde.rs` — add one test
(`unknown_optional_field_is_tolerated_byte_identically`); reword the
`LoadError::UnsupportedVersion` doc comment. No code/behaviour change.
- `docs/design/INDEX.md` — C24 Status/Remaining update (codification).
## Data flow
Unchanged. `blueprint_from_json` → `serde_json::from_str::<BlueprintDoc>` (ignores
unknown fields) → version check → `reconstruct` (resolves each `type_id` through
the injected vocabulary). The test exercises exactly this path with an
unknown-key-bearing input.
## Error handling
Unchanged and already complete: `LoadError::{Json, UnsupportedVersion,
UnknownNodeType}` — typed, named, never a panic, never a silent wrong graph. The
two Tier-2 arms are the must-understand refusals; the new test asserts the Tier-1
path does **not** error.
## Testing strategy
- **New (Tier-1, the gap):** `unknown_optional_field_is_tolerated_byte_identically`
— an unknown optional key at doc and primitive level is ignored; the
reconstructed graph re-serializes byte-identically to the canonical form and
runs bit-identically (C1).
- **Existing (Tier-2, cited as grounding evidence, unchanged):**
`unsupported_version_fails_named`, `unknown_node_type_fails_named`.
- Full workspace gate: `cargo test --workspace`; lint `cargo clippy --workspace
--all-targets -- -D warnings`.
## Acceptance criteria
- [ ] **(a) Tier-1 additive forward-tolerance** — a blueprint JSON carrying an
unknown optional field/section loads on the current loader, the unknown key does
not leak into the graph (byte-identical re-serialization), and the run is
bit-identical. Pinned by the new test.
- [ ] **(b) Tier-2 must-understand refusal** — a too-new `format_version` and an
out-of-vocabulary node each yield a clean, named `LoadError` (never a panic,
never a silent graph change). Already green (`unsupported_version_fails_named`,
`unknown_node_type_fails_named`); unchanged by this cycle.
- [ ] The two-tier discipline is codified in the `LoadError` doc and the C24
ledger entry; the deferred per-section required-flag mechanism is recorded as
out-of-scope on #156.
- [ ] `cargo test --workspace` green; `cargo clippy --workspace --all-targets -- -D
warnings` clean.