14a91f0ae5
Closes Gitea #4. Removes the Boehm-Demers-Weiser conservative GC backend wholesale across six layers in one atomic iteration. After this iter, `AllocStrategy` has two variants (`Rc`, `Bump`), `--alloc=gc` is rejected at CLI parse with `unknown --alloc value`, the libgc link arm is gone, and the design ledger describes RC (canonical) + bump (raw-alloc bench-floor) as the only allocators. Layer-by-layer summary: CLI surface — `crates/ail/src/main.rs`: `parse_alloc_strategy` arm `"gc" => Ok(AllocStrategy::Gc)` removed; error wording updated to `(expected `rc` or `bump`)`; clap-derive `value_parser = ["gc","bump","rc"]` allowlist on BOTH `Build` and `Run` subcommands DROPPED so that `parse_alloc_strategy` remains the sole gatekeeper for the unknown-value diagnostic (otherwise clap shadows the runtime diagnostic with `invalid value 'gc' for '--alloc'`, which would miss the milestone-pin's stderr substring check). The `default_value = "rc"` stays. Codegen — `crates/ailang-codegen/src/lib.rs`: `AllocStrategy::Gc` variant + `Default` derive removed (no caller of `AllocStrategy::default()` existed in the workspace, so the trait derivation was dead). `fn_name` (spec called it `runtime_alloc_fn` loosely; actual identifier is `fn_name`) drops the `Gc => "GC_malloc"` arm. `lower_workspace` and `lower_workspace_staticlib` defaults flip from `Gc` to `Rc`. In-source negative-complement codegen test (mod tests, lib.rs:3571ff) retargets from `AllocStrategy::Gc` to `AllocStrategy::Bump` (bump also doesn't emit per-type drop fns; the test's semantic "no drop fns under non-RC" is preserved). Link branch — `crates/ail/src/main.rs:2389ff`: The `match strategy { AllocStrategy::Gc => { ... cmd.arg("-lgc"); ... } }` arm and its libgc-link block are entirely gone. The surviving match exhausts on `Bump` and `Rc` (Rust's exhaustiveness check confirms; no `error[E0004]`). Staticlib-guard diagnostic rewritten to drop the "shared Boehm collector" phrasing while preserving the prefix `staticlib (swarm) artefact is RC-only` verbatim (the surviving `staticlib_bump_is_rejected` test depends on that substring). Test suite — 3 pure-differential e2e tests deleted (`gc_handles_recursive_list_construction`, `alloc_rc_produces_same_stdout_as_gc`, `alloc_rc_matches_gc_on_std_list_demo`); 9 RC-feature tests stripped of their `stdout_gc` build call and differential `assert_eq!(stdout_gc, stdout_rc, ...)` (absolute `assert_eq!(stdout_rc.trim(), "<n>")` pin retained as correctness oracle); `staticlib_gc_is_rejected` deleted; new milestone-pin `crates/ail/tests/boehm_retirement_pin.rs` asserts `ail build --alloc=gc` exits ≠ 0 with stderr containing `unknown --alloc value` and `\`gc\``; `examples/gc_stress.ail` fixture deleted (no remaining references). Implementer expansion (not in plan): `iter17a_local_box_alloca` (in `e2e.rs`) carried an IR-shape assertion against `@GC_malloc`-absence as the witness for non-escaping allocation. After the Task-2 codegen default flip, the witness shifts to `@ailang_rc_alloc`-absence in escape-targeted positions; assertion + doc-comment updated. Property protected ("no heap allocation in non-escaping contexts") is unchanged; only the named allocator shifts. Bench harness — `bench/run.sh` 9→6 column compaction (workload + bump(s) + rc(s) + rc/bump + bump RSS + rc RSS); gc-arm `bench_latency_implicit_gc` build call + harness invocation dropped from latency block; header comment reframed from "GC-overhead bench harness" to "RC-overhead bench harness"; "Decision 10's Boehm-retirement target (1.3x)" rewording to "RC-overhead-vs-bump bench-health regression gate". `bench/check.py:62` header-sentinel changes from `"gc(s)" in line` to `"bump(s)" in line`; column-count check at `:72` flips from `!= 9` to `!= 6`; per-workload field set drops `gc_s`/`gc_over_bump`/`gc_rss_kb`; `ARM_LABEL_TO_KEY` drops the `"implicit @ gc": "implicit_at_gc"` entry. `bench/baseline.json` regenerated via `--update-baseline`. Implementer note (planner-defect): `write_new_baseline` iterated over the *existing* baseline's metric list when emitting the regenerated file, so even after parser-level `gc_*` removal, the fallback emitted them back into the JSON. Scrubbed post-update; the cleaner fix (have `write_new_baseline` emit only keys present in `parsed_throughput[workload]`) is a follow-up if the script becomes load-bearing for further allocator changes. Design ledger — `design/models/rc-uniqueness.md` excises the `## Dual allocator — RC canonical, Boehm parity oracle` section and the `Boehm-Demers-Weiser conservative GC` choice block + rationale + trade-offs; the per-fn-alloca section generalises Boehm-specific language to allocator-agnostic; the memory-model section's `## Choice.` paragraph reframes the 1.3× target from "Boehm-retirement gate" to "bench-health regression gate". `design/models/pipeline.md` drops the `--alloc=gc → links libgc` arm of the pipeline diagram and replaces it with `--alloc=bump → links bump-floor`; the accompanying prose rewrites accordingly. `design/contracts/scope-boundaries.md` rewrites the "Memory management via Boehm conservative GC" bullet to describe RC + per-fn-arena present-tense; the dead reference to `examples/gc_stress.ail.json` (file never existed; the fixture only ever had a `.ail` form, deleted by this iter) is dropped along with the `examples/std_list_stress.ail.json` reference whose purpose was Boehm-only soak testing. `:67`'s `@printf` / `@GC_malloc` parenthetical updated. `design/contracts/memory-model.md:232` drops the "leaks like the pre-Boehm era" phrase; the RC inc/dec instrumentation is wired up, so the "until then" conditional that referenced pre-Boehm is closed. `design/contracts/embedding-abi.md:42-44` rewrites the staticlib-guard prose to drop the `--alloc=gc` clause (gc is now a CLI-parser-level unknown-value, not a staticlib-guard rejection) and reframe the swarm-safety justification around `--alloc=bump` (leak-only bench instrument) rather than the historical Boehm collector. Honesty pin — `crates/ailang-core/tests/docs_honesty_pin.rs` inverts the polarity: the present-tense Boehm-anchor assertion on `pipeline.md` (`:116-117`) is deleted, and four absence-pins are added to `design_md_has_no_wunschdenken` against the Boehm-zombie strings `transitional Boehm`, `parity oracle`, `GC_malloc`, `libgc`. The `design_corpus()` already includes `rc-uniqueness.md` so no path-list change was needed for the new pins to scan. `crates/ailang-core/tests/design_index_pin.rs:166` drops the `"pre-Boehm"` token from the protected-exception comment list (the phrase no longer appears in `memory-model.md` after this iter, so the exception is dead). Runtime docs — `runtime/bump.c`, `runtime/rc.c`, `runtime/str.c` header comments scrubbed of Boehm/`GC_malloc`/`libgc` references. `bump.c`'s function signature description still documents `void *bump_malloc(size_t)` as the bench-floor allocator interface, but no longer cross-references libgc. Example fixtures — `examples/bench_latency_implicit.ail`, `bench_latency_explicit.ail`, `escape_local_demo.ail`, `reuse_as_demo.ail`, `rc_pin_recurse_implicit.ail` doc-comment headers scrubbed of `--alloc=gc` / Boehm references. The `.ail` surface (AST) is untouched in every case; round-trip invariant holds (`cargo test -p ailang-surface --test round_trip` green). Skill / agent prompts — `skills/audit/agents/ailang-bencher.md` rewritten to use an RC-vs-bump worked example pattern for the hypothesis-driven bench tutorial, replacing the recurring "RC vs Boehm under heap pressure" example. `skills/implement/agents/ailang-implementer.md` Decision-10 / Boehm references replaced with present-tense RC-commitment framing. IR snapshots — the 5 checked-in snapshots (`crates/ail/tests/snapshots/{hello,list,max3,sum,ws_main}.ll`) regenerated via `UPDATE_SNAPSHOTS=1 cargo test -p ail --test ir_snapshot`. Each previously contained `declare ptr @GC_malloc(i64)` and (for `list.ll`) a `call ptr @GC_malloc(...)` invocation; post-flip the snapshots contain `declare ptr @ailang_rc_alloc(i64)` plus the rc inc/dec runtime declarations. Spec-vs-acceptance addendum (caught at orchestrator end-report, absorbed here rather than in a follow-up spec edit): spec §6 acceptance criteria said "Boehm-grep returns matches ONLY in docs_honesty_pin.rs". The plan itself prescribed historical Boehm references in 3 additional files: (a) the new milestone-pin `boehm_retirement_pin.rs` (must literally invoke `--alloc=gc` to assert its rejection), (b) `embed_staticlib_alloc_guard.rs` file doc-comment historical note ("`--alloc=gc` no longer exists as a CLI value"), (c) `embedding-abi.md:44-45` contract historical clause ("see the Boehm-retirement iter"). All three are prescribed; the spec's grep wording was too narrow. The four absence-pins in `docs_honesty_pin.rs` catch the actual zombies (Boehm-narrative re-emerging in the design ledger), which is the substantive intent the spec was aiming at — the four extra documented-by-design exceptions are the cost of having an explicit milestone-pin and contract-level historical anchors. Net delta: - 32 files modified, 2 new (boehm_retirement_pin.rs + stats), 1 deleted (gc_stress.ail); - workspace tests: every binary `0 failed`. Pass-count delta: -3 net (4 e2e tests deleted, 1 new milestone-pin test added); - boehm-grep state: hits only in the four by-design exceptions documented above; - `bench/check.py` exit 0 against regenerated baseline; - CLI must-fail fixture: `ail build --alloc=gc examples/hello.ail` exits non-zero with stderr containing `unknown --alloc value` and `\`gc\``; - design ledger present-tense honest (Boehm-narrative gone from `rc-uniqueness.md` + `pipeline.md`; the few historical references in `embedding-abi.md` / `boehm_retirement_pin.rs` / `embed_staticlib_alloc_guard.rs` are explicit milestone-pins or contract anchors, not silent ledger residue). Bench measurement variance noted: closure-chain and hof-pipeline are ±1-5% jittery between runs; one regeneration flagged 2 metrics as `regressed` before a second run returned 0. The captured baseline is within self-comparison range. Existing per-metric tolerances absorb the jitter. Stats file: `bench/orchestrator-stats/2026-05-20-iter-boehm-retirement.1.json`. closes #4
189 lines
10 KiB
Markdown
189 lines
10 KiB
Markdown
# What is not (yet) supported
|
|
|
|
## What is not (yet) supported
|
|
|
|
Snapshot of the current boundary.
|
|
|
|
- No effect handlers — only the built-in `IO` op (`io/print_str`);
|
|
the effect system is described in [effects](../models/effects.md).
|
|
`Diverge` is a reserved effect name with no op and no codegen.
|
|
- No refinements / SMT escalation.
|
|
- No HM inference inside bodies. Top-level def types are explicit;
|
|
polymorphism is opt-in via `Type::Forall { vars, body }` (see
|
|
[Data model](data-model.md)). Inside a body, lambdas check
|
|
monomorphically against their declared type.
|
|
- Polymorphic fns must be **directly called** at the use site.
|
|
Passing a polymorphic fn as a value (`let f = id in f(42)`) is
|
|
not yet supported.
|
|
- No higher-rank polymorphism. Passing a polymorphic fn to another
|
|
polymorphic fn (`apply(id, 42)`) is not supported.
|
|
- No recursive `let` for non-fn values. Plain `let x = … in …` only
|
|
sees `x` inside the body, not inside its own RHS — recursive value
|
|
bindings would break the
|
|
[acyclicity invariant](language-constraints.md). Recursive
|
|
*fn* bindings are supported via `Term::LetRec` (`{ "t": "letrec",
|
|
... }`); the desugar pass lifts most occurrences to a synthetic
|
|
top-level fn, with `lift_letrecs` finishing the residue after
|
|
typecheck (see [pipeline](../models/pipeline.md)).
|
|
- No visibility rules in imports. Every top-level def of an imported module
|
|
is reachable; there is no `pub` / `priv`.
|
|
|
|
What **is** supported (and used as the smoke test for the pipeline):
|
|
|
|
- Int, Bool, Unit, **Str**, **Float** as primitive types.
|
|
- `if`, `let`, function calls, recursion.
|
|
- Effects on function signatures, with `do op(args)` for direct effect
|
|
ops (`io/print_str`). The polymorphic `print` (see
|
|
[prelude classes](prelude-classes.md)) is the canonical output
|
|
path for non-Str values.
|
|
- **Builtins.** Arithmetic operators (`+`, `-`, `*`, `/`) of type
|
|
`forall a. (a, a) -> a` (codegen-restricted to `{Int, Float}`);
|
|
`%` of type `(Int, Int) -> Int` (Int-only — `fmod` semantics for
|
|
Float deferred); ordering operators and `!=` (`!=`, `<`, `<=`,
|
|
`>`, `>=`) of type `forall a. (a, a) -> Bool` (codegen-restricted
|
|
to `{Int, Float}`); polymorphic `neg : forall a. (a) -> a`
|
|
(codegen-restricted to `{Int, Float}`; Float arm uses LLVM
|
|
`fneg double` for correct `-0.0` handling); logical
|
|
`not : (Bool) -> Bool`; conversions
|
|
`int_to_float : (Int) -> Float`,
|
|
`float_to_int_truncate : (Float) -> Int` (saturating, NaN → 0),
|
|
`float_to_str : (Float) -> Str`,
|
|
`int_to_str : (Int) -> Str` (both allocate a heap-Str slab at
|
|
call time and return it with `ret_mode: Own`; see [Str ABI](str-abi.md) for
|
|
the dual heap-/static-Str realisation); inspection
|
|
`is_nan : (Float) -> Bool` (LLVM
|
|
`fcmp uno`); Float bit-pattern constants `nan : Float`,
|
|
`inf : Float`, `neg_inf : Float` (resolved as bare values, lower
|
|
to direct hex-float `double` SSA constants at use site); the IO
|
|
effect op `io/print_str`; **`==` : forall a.
|
|
(a, a) -> Bool**; and **`__unreachable__ : forall a. a`**.
|
|
- **`==` is polymorphic.** The typechecker accepts
|
|
`==` at any type whose two sides agree (the rigid `a` of the
|
|
`Forall` is unified by HM at the use site). Codegen
|
|
monomorphises and dispatches on the resolved AIL arg type:
|
|
`Int` → `icmp eq i64`; `Bool` → `icmp eq i1`;
|
|
`Str` → `call @strcmp(ptr, ptr)` then `icmp eq i32 0`
|
|
(`@strcmp` is declared in the LLVM IR header alongside
|
|
`@printf` / `@ailang_rc_alloc`); `Unit` → constant `i1 true`
|
|
(Unit has a single inhabitant; both sides are still
|
|
evaluated for any side effects); `Float` → `fcmp oeq double`.
|
|
ADT and `Fn` arg types are rejected at codegen with a
|
|
`CodegenError::Internal` mentioning `==` and the offending
|
|
type — neither has a canonical structural-equality scheme
|
|
yet, and the language deliberately does not silently elide
|
|
the check. **`!=` for Float uses `fcmp UNE double` (NOT
|
|
`one`)** — `one` is "ordered and not equal" and would return
|
|
false for `nan != nan`, violating IEEE-`!=`.
|
|
- **`__unreachable__`** is a polymorphic bottom value: a use of
|
|
`__unreachable__` typechecks against any expected type at
|
|
the use site and codegens to the LLVM `unreachable`
|
|
instruction (UB if ever executed). It is the chain
|
|
machinery's deepest fall-through for matches that the
|
|
typechecker proved exhaustive, and it is available to user
|
|
code as an explicit panic primitive
|
|
(`(if cond __unreachable__ ...)` for assertions or
|
|
impossible branches). Reference site is
|
|
`Term::Var { name = "__unreachable__" }` / form-A bare
|
|
`__unreachable__`.
|
|
- **ADTs + pattern matching.** Sub-patterns of a Ctor pattern may be `Var`, `Wild`,
|
|
another `Ctor`, or a literal. The desugar pass flattens
|
|
nested Ctor patterns into a chain of let + match and rewrites every
|
|
`Pattern::Lit` (top-level or sub-) to a `Term::If` on `==` before
|
|
typecheck/codegen — see [desugar](../../crates/ailang-core/src/desugar.rs) and [Pipeline](../models/pipeline.md).
|
|
- Literal patterns at top level and inside Ctor sub-patterns (via desugar).
|
|
`(pat-lit 0)` and `(pat-ctor Cons (pat-lit 0) _)` both
|
|
parse and lower; the rewrite is to `Term::If { cond = (== sv lit) }`,
|
|
so any literal kind whose `==` is supported is authorable. With `==`
|
|
polymorphic over `Int`/`Bool`/`Str`/`Unit`, that
|
|
covers every lit kind the AST ships — including `(pat-lit "hi")`
|
|
over a `Str` scrutinee, exercised by `examples/eq_demo.ail.json`.
|
|
- **Imports + qualified cross-module references** via dotted names.
|
|
Extends to **types and constructors**: a foreign
|
|
module's ADT is referenced as `(con std_pair.Pair a b)`, its ctors as
|
|
`(term-ctor std_pair.Pair MkPair x y)` and `(pat-ctor MkPair x y)`
|
|
inside that scrutinee. Std-library demos (`examples/std_*_demo.ail.json`)
|
|
exercise this end-to-end.
|
|
- **AI-authoring text surface, form (A)** (see
|
|
[authoring surface](authoring-surface.md)). The `ailang-surface`
|
|
crate parses `.ail` form-A text into a canonical
|
|
`ailang-core::ast::Module` and prints any module back as form-A
|
|
text. `ail render` and `ail describe` use it as the
|
|
sole text projection; `ail parse` is the inverse direction. Round-trip
|
|
identity (text → AST → JSON → AST → text) is gated by
|
|
`ailang-surface/tests/round_trip.rs` over every shipped fixture.
|
|
- **Memory management via reference counting + uniqueness inference**
|
|
(see [RC + uniqueness](../models/rc-uniqueness.md)), with
|
|
**per-fn arena via stack `alloca` for non-escaping allocations**
|
|
layered on top. Every ADT box, lambda env, and closure pair
|
|
allocates either via `@ailang_rc_alloc` (escaping; RC-managed
|
|
with inc/dec instrumentation per the memory model) or via LLVM
|
|
`alloca` (non-escaping; freed at fn return). The decision is
|
|
made by an escape-analysis pre-pass over the fn body — see the
|
|
"Per-fn arena via stack `alloca`" subsection of
|
|
[RC + uniqueness](../models/rc-uniqueness.md). The per-fn-arena
|
|
path is exercised end-to-end by
|
|
`examples/escape_local_demo.ail.json`.
|
|
- **First-class function references.** A top-level fn name (or
|
|
qualified `prefix.def`) used as a `Term::Var` is a fn-value.
|
|
- **Anonymous lambdas with capture.** `Term::Lam` constructs a
|
|
closure that captures any free variables of its body from the
|
|
enclosing scope. All fn-values share a single ABI: a `ptr` to a
|
|
closure pair `{ thunk_ptr, env_ptr }`. Top-level fns get an auto-
|
|
generated adapter and a static closure pair (env = null) so they
|
|
remain passable as values without heap overhead.
|
|
- **Polymorphism via `Type::Forall`** at top-level def types.
|
|
Use sites instantiate fresh metavars; unification pins them against
|
|
the concrete types of the call args. Codegen monomorphises on
|
|
demand: each unique instantiation emits a specialised LLVM fn
|
|
mangled `@ail_<m>_<def>__<descriptor>` (e.g. `id__I` for `id` at
|
|
`Int`, `apply__I_I` for `apply` at `(Int, Int)`).
|
|
- **Parameterised ADTs.** `TypeDef.vars: Vec<String>`
|
|
declares type parameters; `Type::Con.args: Vec<Type>` carries the
|
|
type arguments at use sites. Both fields default to empty and are
|
|
skipped during serialization, so canonical-JSON hashes of every
|
|
existing definition stay bit-identical (regression test in
|
|
`crates/ailang-core/src/hash.rs`). Ctor and match codegen stay
|
|
inline at every use site — there is no specialised ADT symbol —
|
|
but LLVM field types are derived per use site by substituting
|
|
through `cdef.ail_fields`. The substitution is read off the call's
|
|
arg types (ctor) or the scrutinee's `Type::Con.args` (match). An
|
|
unresolved `Type::Var` reaching `llvm_type` is a hard error
|
|
rather than a silent fallback to `ptr`.
|
|
Pipeline regression smoke tests:
|
|
|
|
- `examples/sum.ail.json` → prints 55 (recursion, arithmetic).
|
|
- `examples/list.ail.json` → prints 42 (ADTs + match).
|
|
- `examples/hof.ail.json` → prints 42 (first-class fn-refs, indirect call).
|
|
- `examples/closure.ail.json` → prints 42 (lambda capturing a let-bound var).
|
|
- `examples/list_map.ail.json` → prints 2/4/6 (ADTs + closure + recursive
|
|
HOF + IO; the dogfood smoke test).
|
|
- `examples/sort.ail.json` → prints sorted [3,1,4,1,5,9,2,6,5,3,5]
|
|
one-per-line (insertion sort over an 11-element list).
|
|
- `examples/poly_id.ail.json` → prints 42 then "true" (polymorphic
|
|
identity at `Int` and `Bool`; two specialised fns emitted).
|
|
- `examples/poly_apply.ail.json` → prints 42 (polymorphic `apply`
|
|
with a fn-typed parameter; `apply(succ, 41)`).
|
|
- `examples/box.ail.json` → prints 42 (parameterised ADT round-
|
|
trip: `MkBox(42)` constructed, then projected by a polymorphic
|
|
`unbox : forall a. (Box<a>) -> a` and printed).
|
|
- `examples/maybe_int.ail.json` → prints 7 then 99 (pattern match
|
|
over `Maybe<Int>`: `or_else(Some(7), 99)` then
|
|
`or_else(None, 99)`).
|
|
- `examples/std_list_demo.ail.json` → exercises
|
|
`std_list`'s combinators (length, sum, reverse, take/drop-style
|
|
uses) end-to-end against `std_list`'s `List<a>`.
|
|
- `examples/std_maybe_demo.ail.json` → exercises `std_maybe`
|
|
combinators over `Maybe<Int>`, including `from_maybe` and `map`.
|
|
- `examples/std_either_demo.ail.json` → first program with
|
|
three distinct type variables in a single fn (the `either`
|
|
eliminator), monomorphised six different ways in the IR.
|
|
- `examples/std_pair_demo.ail.json` → drives every
|
|
`std_pair` combinator (fst, snd, swap, map_first, map_second);
|
|
expected output 7, 9, 9, 7, 8, 18.
|
|
- `examples/nested_pat.ail.json` → first program to use a
|
|
nested `(pat-ctor Cons a (pat-ctor Cons b _))`; the desugar pass
|
|
flattens it into a chain that the existing flat-match codegen
|
|
consumes. Prints 30 for a 3-element input list.
|
|
|
|
Ratified by: `crates/ailang-core/tests/effect_doc_honesty_pin.rs`.
|