Files
AILang/runtime/str.c
T
Brummel 14a91f0ae5 iter boehm-retirement.1 (DONE 10/10): retire the transitional Boehm GC backend
Closes Gitea #4. Removes the Boehm-Demers-Weiser conservative GC
backend wholesale across six layers in one atomic iteration. After
this iter, `AllocStrategy` has two variants (`Rc`, `Bump`),
`--alloc=gc` is rejected at CLI parse with `unknown --alloc value`,
the libgc link arm is gone, and the design ledger describes RC
(canonical) + bump (raw-alloc bench-floor) as the only allocators.

Layer-by-layer summary:

  CLI surface — `crates/ail/src/main.rs`:
    `parse_alloc_strategy` arm `"gc" => Ok(AllocStrategy::Gc)`
    removed; error wording updated to `(expected `rc` or `bump`)`;
    clap-derive `value_parser = ["gc","bump","rc"]` allowlist on
    BOTH `Build` and `Run` subcommands DROPPED so that
    `parse_alloc_strategy` remains the sole gatekeeper for the
    unknown-value diagnostic (otherwise clap shadows the runtime
    diagnostic with `invalid value 'gc' for '--alloc'`, which would
    miss the milestone-pin's stderr substring check). The
    `default_value = "rc"` stays.

  Codegen — `crates/ailang-codegen/src/lib.rs`:
    `AllocStrategy::Gc` variant + `Default` derive removed (no
    caller of `AllocStrategy::default()` existed in the workspace,
    so the trait derivation was dead). `fn_name` (spec called it
    `runtime_alloc_fn` loosely; actual identifier is `fn_name`)
    drops the `Gc => "GC_malloc"` arm. `lower_workspace` and
    `lower_workspace_staticlib` defaults flip from `Gc` to `Rc`.
    In-source negative-complement codegen test (mod tests, lib.rs:3571ff)
    retargets from `AllocStrategy::Gc` to `AllocStrategy::Bump`
    (bump also doesn't emit per-type drop fns; the test's semantic
    "no drop fns under non-RC" is preserved).

  Link branch — `crates/ail/src/main.rs:2389ff`:
    The `match strategy { AllocStrategy::Gc => { ... cmd.arg("-lgc"); ... } }`
    arm and its libgc-link block are entirely gone. The surviving
    match exhausts on `Bump` and `Rc` (Rust's exhaustiveness check
    confirms; no `error[E0004]`). Staticlib-guard diagnostic
    rewritten to drop the "shared Boehm collector" phrasing while
    preserving the prefix `staticlib (swarm) artefact is RC-only`
    verbatim (the surviving `staticlib_bump_is_rejected` test
    depends on that substring).

  Test suite — 3 pure-differential e2e tests deleted
    (`gc_handles_recursive_list_construction`,
    `alloc_rc_produces_same_stdout_as_gc`,
    `alloc_rc_matches_gc_on_std_list_demo`); 9 RC-feature tests
    stripped of their `stdout_gc` build call and differential
    `assert_eq!(stdout_gc, stdout_rc, ...)` (absolute
    `assert_eq!(stdout_rc.trim(), "<n>")` pin retained as
    correctness oracle); `staticlib_gc_is_rejected` deleted; new
    milestone-pin `crates/ail/tests/boehm_retirement_pin.rs`
    asserts `ail build --alloc=gc` exits ≠ 0 with stderr containing
    `unknown --alloc value` and `\`gc\``; `examples/gc_stress.ail`
    fixture deleted (no remaining references).

    Implementer expansion (not in plan): `iter17a_local_box_alloca`
    (in `e2e.rs`) carried an IR-shape assertion against
    `@GC_malloc`-absence as the witness for non-escaping
    allocation. After the Task-2 codegen default flip, the witness
    shifts to `@ailang_rc_alloc`-absence in escape-targeted
    positions; assertion + doc-comment updated. Property
    protected ("no heap allocation in non-escaping contexts") is
    unchanged; only the named allocator shifts.

  Bench harness — `bench/run.sh` 9→6 column compaction
    (workload + bump(s) + rc(s) + rc/bump + bump RSS + rc RSS);
    gc-arm `bench_latency_implicit_gc` build call + harness
    invocation dropped from latency block; header comment reframed
    from "GC-overhead bench harness" to "RC-overhead bench
    harness"; "Decision 10's Boehm-retirement target (1.3x)"
    rewording to "RC-overhead-vs-bump bench-health regression gate".

    `bench/check.py:62` header-sentinel changes from
    `"gc(s)" in line` to `"bump(s)" in line`; column-count check
    at `:72` flips from `!= 9` to `!= 6`; per-workload field set
    drops `gc_s`/`gc_over_bump`/`gc_rss_kb`; `ARM_LABEL_TO_KEY`
    drops the `"implicit @ gc": "implicit_at_gc"` entry.
    `bench/baseline.json` regenerated via `--update-baseline`.

    Implementer note (planner-defect): `write_new_baseline`
    iterated over the *existing* baseline's metric list when
    emitting the regenerated file, so even after parser-level
    `gc_*` removal, the fallback emitted them back into the JSON.
    Scrubbed post-update; the cleaner fix (have
    `write_new_baseline` emit only keys present in
    `parsed_throughput[workload]`) is a follow-up if the script
    becomes load-bearing for further allocator changes.

  Design ledger — `design/models/rc-uniqueness.md` excises the
    `## Dual allocator — RC canonical, Boehm parity oracle`
    section and the `Boehm-Demers-Weiser conservative GC` choice
    block + rationale + trade-offs; the per-fn-alloca section
    generalises Boehm-specific language to allocator-agnostic;
    the memory-model section's `## Choice.` paragraph reframes the
    1.3× target from "Boehm-retirement gate" to "bench-health
    regression gate".

    `design/models/pipeline.md` drops the `--alloc=gc → links libgc`
    arm of the pipeline diagram and replaces it with
    `--alloc=bump → links bump-floor`; the accompanying prose
    rewrites accordingly.

    `design/contracts/scope-boundaries.md` rewrites the
    "Memory management via Boehm conservative GC" bullet to
    describe RC + per-fn-arena present-tense; the dead reference
    to `examples/gc_stress.ail.json` (file never existed; the
    fixture only ever had a `.ail` form, deleted by this iter) is
    dropped along with the `examples/std_list_stress.ail.json`
    reference whose purpose was Boehm-only soak testing.
    `:67`'s `@printf` / `@GC_malloc` parenthetical updated.

    `design/contracts/memory-model.md:232` drops the
    "leaks like the pre-Boehm era" phrase; the RC inc/dec
    instrumentation is wired up, so the "until then" conditional
    that referenced pre-Boehm is closed.

    `design/contracts/embedding-abi.md:42-44` rewrites the
    staticlib-guard prose to drop the `--alloc=gc` clause (gc is
    now a CLI-parser-level unknown-value, not a staticlib-guard
    rejection) and reframe the swarm-safety justification around
    `--alloc=bump` (leak-only bench instrument) rather than the
    historical Boehm collector.

  Honesty pin — `crates/ailang-core/tests/docs_honesty_pin.rs`
    inverts the polarity: the present-tense Boehm-anchor assertion
    on `pipeline.md` (`:116-117`) is deleted, and four
    absence-pins are added to `design_md_has_no_wunschdenken`
    against the Boehm-zombie strings `transitional Boehm`,
    `parity oracle`, `GC_malloc`, `libgc`. The
    `design_corpus()` already includes `rc-uniqueness.md` so no
    path-list change was needed for the new pins to scan.

    `crates/ailang-core/tests/design_index_pin.rs:166` drops the
    `"pre-Boehm"` token from the protected-exception comment list
    (the phrase no longer appears in `memory-model.md` after this
    iter, so the exception is dead).

  Runtime docs — `runtime/bump.c`, `runtime/rc.c`, `runtime/str.c`
    header comments scrubbed of Boehm/`GC_malloc`/`libgc`
    references. `bump.c`'s function signature description still
    documents `void *bump_malloc(size_t)` as the bench-floor
    allocator interface, but no longer cross-references libgc.

  Example fixtures — `examples/bench_latency_implicit.ail`,
    `bench_latency_explicit.ail`, `escape_local_demo.ail`,
    `reuse_as_demo.ail`, `rc_pin_recurse_implicit.ail` doc-comment
    headers scrubbed of `--alloc=gc` / Boehm references. The
    `.ail` surface (AST) is untouched in every case; round-trip
    invariant holds (`cargo test -p ailang-surface --test round_trip`
    green).

  Skill / agent prompts — `skills/audit/agents/ailang-bencher.md`
    rewritten to use an RC-vs-bump worked example pattern for the
    hypothesis-driven bench tutorial, replacing the recurring
    "RC vs Boehm under heap pressure" example.
    `skills/implement/agents/ailang-implementer.md` Decision-10 /
    Boehm references replaced with present-tense RC-commitment
    framing.

  IR snapshots — the 5 checked-in snapshots
    (`crates/ail/tests/snapshots/{hello,list,max3,sum,ws_main}.ll`)
    regenerated via `UPDATE_SNAPSHOTS=1 cargo test -p ail --test
    ir_snapshot`. Each previously contained
    `declare ptr @GC_malloc(i64)` and (for `list.ll`) a `call ptr
    @GC_malloc(...)` invocation; post-flip the snapshots contain
    `declare ptr @ailang_rc_alloc(i64)` plus the rc inc/dec runtime
    declarations.

Spec-vs-acceptance addendum (caught at orchestrator end-report,
absorbed here rather than in a follow-up spec edit): spec §6
acceptance criteria said "Boehm-grep returns matches ONLY in
docs_honesty_pin.rs". The plan itself prescribed historical Boehm
references in 3 additional files: (a) the new milestone-pin
`boehm_retirement_pin.rs` (must literally invoke `--alloc=gc` to
assert its rejection), (b) `embed_staticlib_alloc_guard.rs` file
doc-comment historical note ("`--alloc=gc` no longer exists as a
CLI value"), (c) `embedding-abi.md:44-45` contract historical
clause ("see the Boehm-retirement iter"). All three are
prescribed; the spec's grep wording was too narrow. The four
absence-pins in `docs_honesty_pin.rs` catch the actual zombies
(Boehm-narrative re-emerging in the design ledger), which is the
substantive intent the spec was aiming at — the four extra
documented-by-design exceptions are the cost of having an
explicit milestone-pin and contract-level historical anchors.

Net delta:
  - 32 files modified, 2 new (boehm_retirement_pin.rs + stats),
    1 deleted (gc_stress.ail);
  - workspace tests: every binary `0 failed`. Pass-count delta:
    -3 net (4 e2e tests deleted, 1 new milestone-pin test added);
  - boehm-grep state: hits only in the four by-design exceptions
    documented above;
  - `bench/check.py` exit 0 against regenerated baseline;
  - CLI must-fail fixture: `ail build --alloc=gc examples/hello.ail`
    exits non-zero with stderr containing `unknown --alloc value`
    and `\`gc\``;
  - design ledger present-tense honest (Boehm-narrative gone from
    `rc-uniqueness.md` + `pipeline.md`; the few historical
    references in `embedding-abi.md` / `boehm_retirement_pin.rs` /
    `embed_staticlib_alloc_guard.rs` are explicit milestone-pins
    or contract anchors, not silent ledger residue).

Bench measurement variance noted: closure-chain and hof-pipeline
are ±1-5% jittery between runs; one regeneration flagged 2
metrics as `regressed` before a second run returned 0. The
captured baseline is within self-comparison range. Existing
per-metric tolerances absorb the jitter.

Stats file:
`bench/orchestrator-stats/2026-05-20-iter-boehm-retirement.1.json`.

closes #4
2026-05-20 20:51:53 +02:00

245 lines
10 KiB
C

/* AILang Str runtime primitives.
*
* Provides ABI-stable string operations against the existing
* constant-Str layout (NUL-terminated byte buffer, passed as
* `ptr` in LLVM IR). Lives separately from runtime/rc.c so that
* a future heap-Str ABI milestone can swap the implementations
* without touching the RC runtime.
*
* Linked unconditionally by `ail build` (Gc, Bump, Rc) so that
* any program that monomorphises `eq__Str` (auto-loaded from
* the prelude) finds the symbol. Programs that never call
* `eq` on Str leave @ail_str_eq as a dead-stripped no-op at
* link time under clang -O2.
*/
#include <stdbool.h>
#include <string.h>
#include <stdint.h>
#include <stdio.h>
#include <stdlib.h>
#include <math.h>
/* Defined in runtime/rc.c — exposed with default external linkage.
* Returns a zero-initialised payload whose `rc_header` sits at
* `payload - 8` and is initialised to refcount 1. str.c's heap-Str
* helpers call this regardless of the program's --alloc strategy,
* because heap-Str values are always refcounted (the global
* `--alloc` flag governs ADT allocation, not Str allocation).
*
* Declared `__attribute__((weak))` in hs.3 so the publicly-visible
* `ailang_int_to_str` / `ailang_float_to_str` symbols can link into
* binaries that do not pull in `runtime/rc.c` (i.e. `--alloc=bump`
* bench builds, where `rc.c` is not linked). Under
* such targets the reference resolves to NULL; the heap-Str helpers
* are not yet called from any IR site (hs.4 wires the lowering), so
* the NULL is never dereferenced at runtime. Under `--alloc=rc` the
* strong definition in `rc.c` wins as usual. Once hs.4 lands the
* unconditional `rc.c` link the `weak` attribute becomes a no-op
* (strong definitions always satisfy weak references); the attribute
* is intentionally retained so str.c remains link-safe in isolation.
*/
extern void *ailang_rc_alloc(size_t size) __attribute__((weak));
/* Byte-equality on NUL-terminated strings. Mirrors strcmp(...) == 0
* but exposed under a stable AILang-namespaced ABI so the codegen
* caller does not assume libc's strcmp shape. Heap-Str ABI milestone
* will replace the body with length-prefixed comparison without
* changing the signature. */
bool ail_str_eq(const char *a, const char *b) {
return strcmp(a, b) == 0;
}
/* Three-way comparison of NUL-terminated strings. Normalises libc
* strcmp's signed-int output to exactly -1 / 0 / +1 so the codegen
* caller can branch on `icmp slt i32 result, 0` and
* `icmp eq i32 result, 0` against constants directly without
* worrying about strcmp implementations that return values outside
* {-1, 0, +1}. Heap-Str ABI milestone will replace the body with
* length-prefixed comparison without changing the signature. */
int ail_str_compare(const char *a, const char *b) {
int r = strcmp(a, b);
if (r < 0) return -1;
if (r > 0) return 1;
return 0;
}
/* Heap-Str slab allocator. Lays out:
*
* [ rc_header (8B) | len (8B) | bytes... | NUL ]
* ^ ^
* payload-8 payload (returned)
*
* Calls `ailang_rc_alloc(8 + len + 1)`. The +8 is the len field;
* the +1 is the trailing NUL byte that keeps `@strcmp` and `@puts`
* happy under the shared consumer ABI. Writes `len` into the first
* 8 bytes of the payload and returns the payload pointer; the
* caller is responsible for filling bytes [8 .. 8 + len) and the
* `NUL` byte at offset `8 + len`.
*
* Private (static linkage) — callers within this TU only.
*/
static char *str_alloc(uint64_t len) {
char *payload = (char *)ailang_rc_alloc(8 + len + 1);
*(uint64_t *)payload = len;
return payload;
}
/* Convert an i64 into a heap-allocated Str. Format `"%lld"`. The
* worst-case width is 20 chars (i64::MIN = "-9223372036854775808");
* a 64-byte stack buffer is comfortably oversized. `snprintf`'s
* return tells us how many bytes *would* have been written; if that
* exceeds the buffer we abort() defensively — this should be
* unreachable for any valid i64 input but survives format-string
* widening if a future change ever swaps `%lld` for something more
* verbose without re-sizing the buffer.
*
* Returns the payload pointer of a fresh heap-Str slab. Caller owns
* the refcount (init to 1 by `ailang_rc_alloc`); standard RC
* discipline (`ailang_rc_inc` / `ailang_rc_dec`) applies.
*/
char *ailang_int_to_str(int64_t n) {
char buf[64];
int written = snprintf(buf, sizeof(buf), "%lld", (long long)n);
if (written < 0 || (size_t)written >= sizeof(buf)) {
fprintf(stderr,
"ailang_int_to_str: snprintf truncation/error "
"(written=%d, buffer=%zu) — should be unreachable for any valid i64; aborting\n",
written, sizeof(buf));
abort();
}
uint64_t len = (uint64_t)written;
char *payload = str_alloc(len);
memcpy(payload + 8, buf, len);
payload[8 + len] = '\0';
return payload;
}
/* Convert a double into a heap-allocated Str. Format `"%g"` —
* the same libc rendering used throughout the runtime for Float
* text output (post-iter-rpe.1 polymorphic `print` for Float
* routes here via `Show Float.show`).
* NaN renders as libc-default (`nan`/`-nan`/etc.); ±Inf as `inf`
* /`-inf`. Worst-case width for `%g` on a `double` is bounded by
* the libc default precision (`%.6g` ⇒ at most ~13 chars including
* sign and exponent); the 64-byte stack buffer is comfortably
* oversized. Defensive `abort()` on truncation, same shape as
* `ailang_int_to_str`.
*
* `.0`-fallback (Gitea #7): if `x` is finite and `%g`'s output
* contains neither `.` nor `e`/`E`, append `.0` so a whole-valued
* Float renders with a Float-shaped suffix instead of Int-shaped
* text. Mirrors the surface printer's `write_float_lit` fallback
* at `crates/ailang-surface/src/print.rs` lines 624-637, keeping
* the surface/runtime round-trip-on-lex symmetry intact. The
* `isfinite(x)` fence skips the fallback for `nan`/`inf`/`-inf`,
* which would otherwise match the no-`.`-no-`e` predicate and
* render as `nan.0`/`inf.0`.
*
* Returns the payload pointer of a fresh heap-Str slab.
*/
char *ailang_float_to_str(double x) {
char buf[64];
int written = snprintf(buf, sizeof(buf), "%g", x);
if (written < 0 || (size_t)written >= sizeof(buf)) {
fprintf(stderr,
"ailang_float_to_str: snprintf truncation/error "
"(written=%d, buffer=%zu) — should be unreachable for any finite double; aborting\n",
written, sizeof(buf));
abort();
}
uint64_t len = (uint64_t)written;
/* `.0`-fallback — see block comment above and the surface
* counterpart at crates/ailang-surface/src/print.rs lines
* 624-637. `%g` output is ASCII, so plain `memchr` suffices. */
if (isfinite(x)
&& memchr(buf, '.', len) == NULL
&& memchr(buf, 'e', len) == NULL
&& memchr(buf, 'E', len) == NULL) {
if (len + 2 >= sizeof(buf)) {
fprintf(stderr,
"ailang_float_to_str: .0-fallback would overflow buffer "
"(len=%llu, buffer=%zu) — should be unreachable for any finite double; aborting\n",
(unsigned long long)len, sizeof(buf));
abort();
}
buf[len] = '.';
buf[len + 1] = '0';
len += 2;
}
char *payload = str_alloc(len);
memcpy(payload + 8, buf, len);
payload[8 + len] = '\0';
return payload;
}
/* Convert a bool into a heap-allocated Str — "true" (4 bytes) or
* "false" (5 bytes). Heap-allocates every call; the static-Str
* literal alternative (used by a hypothetical `\x -> if x then "true"
* else "false"` schema body) would require phi-of-static-Str
* through the drop-elision pipeline which is not load-bearing-
* ratified today (see parent spec §"Out of scope" / `bool_to_str` as
* schema-if).
*
* Returns the payload pointer of a fresh heap-Str slab.
*/
char *ailang_bool_to_str(bool b) {
const char *lit = b ? "true" : "false";
uint64_t len = b ? 4 : 5;
char *payload = str_alloc(len);
memcpy(payload + 8, lit, len);
payload[8 + len] = '\0';
return payload;
}
/* Clone a Str into a fresh heap-Str slab. Reads `len` from the
* first 8 bytes of the source payload, allocates a new slab of the
* same length via `str_alloc`, and memcpy's the payload bytes plus
* the trailing NUL. Works uniformly on static-Str and heap-Str
* inputs because the consumer ABI (i64 len at offset 0, bytes
* starting at offset 8, NUL at offset 8 + len) is identical
* between realisations (see design/contracts/str-abi.md); the rc_header at
* offset -8 — present only on heap-Str — is never consulted.
*
* Used by `show__Str` (parent spec milestone 24): converts a
* borrowed Str input into an Owned heap-Str output, preserving
* the uniform `show : forall a. Show a => (a borrow) -> Str Own`
* signature.
*
* Returns the payload pointer of a fresh heap-Str slab.
*/
char *ailang_str_clone(const char *src) {
uint64_t len = *(const uint64_t *)src;
char *payload = str_alloc(len);
memcpy(payload + 8, src + 8, len);
payload[8 + len] = '\0';
return payload;
}
/*
* `ailang_str_concat(a, b)` — heap-Str concatenation primitive
* shipped in iter str-concat (2026-05-13). Reads `len` headers from
* both source Str payloads (offset 0 of each), allocates a fresh
* heap-Str slab sized for the combined bytes via `str_alloc`,
* memcpys both payloads in order, NUL-terminates, returns the new
* payload pointer. Like `str_clone`, this works uniformly on static-
* Str and heap-Str inputs because the consumer ABI is identical
* between realisations (see design/contracts/str-abi.md).
*
* Used by Show bodies that want labelled output (e.g.
* `"Item " ++ int_to_str n`) and by any caller that needs to
* combine two existing Str values into a new owned Str.
*
* Returns the payload pointer of a fresh heap-Str slab. The rc
* header is initialised to 1 by `str_alloc`.
*/
char *ailang_str_concat(const char *a, const char *b) {
uint64_t la = *(const uint64_t *)a;
uint64_t lb = *(const uint64_t *)b;
char *payload = str_alloc(la + lb);
memcpy(payload + 8, a + 8, la);
memcpy(payload + 8 + la, b + 8, lb);
payload[8 + la + lb] = '\0';
return payload;
}