Files
AILang/bench/baseline_compile.json
T
Brummel 94616240ec audit 23: ratify compile_check baseline + DESIGN.md stub-fix
Milestone-23 close audit. Architect clean on substance; one
pre-existing DESIGN.md grammar stub (line 1692, dangling 'The
original' from 2026-05-10 design-md-consolidation) caught and
fixed.

Bencher localised the compile_check.py regression to H2 (the 5 new
polymorphic prelude Def::Fns iter 23.5 added — each carries forall
+ class constraint + match/not body, all typechecked on every
workspace check). H1 (linearity workspace-visibility extension +
contains_rigid_var) is negligible at today's 2-module workspace.

The regression is the feature's measured cost. Ratified per audit
skill (--update-baseline + journal entry). 0/24 metrics regressed
post-update.

Milestone 23 (Eq/Ord prelude) is closed.
2026-05-12 00:57:12 +02:00

107 lines
2.4 KiB
JSON

{
"version": 1,
"captured": "2026-05-12",
"captured_via": "bench/compile_check.py",
"note": "Compile-time bench. `check_ms` is `ail check FILE`; `build_O0_ms` is `ail build --opt=-O0 FILE`. Wall-clock includes subprocess spawn (~5-10 ms on Linux) and, for build, the clang link step. Tolerances are tuned for noise on a quiet developer machine, not as the language correctness bar.",
"check_ms": {
"hello": {
"baseline_ms": 1.16,
"tolerance_pct": 25
},
"list_map_poly": {
"baseline_ms": 1.43,
"tolerance_pct": 25
},
"local_rec_capture": {
"baseline_ms": 1.41,
"tolerance_pct": 25
},
"borrow_own_demo": {
"baseline_ms": 1.33,
"tolerance_pct": 25
},
"nested_pat": {
"baseline_ms": 2.73,
"tolerance_pct": 25
},
"bench_list_sum": {
"baseline_ms": 1.54,
"tolerance_pct": 25
},
"bench_tree_walk": {
"baseline_ms": 1.38,
"tolerance_pct": 25
},
"bench_closure_chain": {
"baseline_ms": 1.42,
"tolerance_pct": 25
},
"bench_hof_pipeline": {
"baseline_ms": 1.48,
"tolerance_pct": 25
},
"bench_compute_intsum": {
"baseline_ms": 1.39,
"tolerance_pct": 25
},
"bench_compute_collatz": {
"baseline_ms": 1.49,
"tolerance_pct": 25
},
"bench_list_sum_explicit": {
"baseline_ms": 1.48,
"tolerance_pct": 25
}
},
"build_O0_ms": {
"hello": {
"baseline_ms": 87.51,
"tolerance_pct": 20
},
"list_map_poly": {
"baseline_ms": 88.52,
"tolerance_pct": 20
},
"local_rec_capture": {
"baseline_ms": 87.27,
"tolerance_pct": 20
},
"borrow_own_demo": {
"baseline_ms": 87.39,
"tolerance_pct": 20
},
"nested_pat": {
"baseline_ms": 90.52,
"tolerance_pct": 20
},
"bench_list_sum": {
"baseline_ms": 87.92,
"tolerance_pct": 20
},
"bench_tree_walk": {
"baseline_ms": 88.14,
"tolerance_pct": 20
},
"bench_closure_chain": {
"baseline_ms": 85.03,
"tolerance_pct": 20
},
"bench_hof_pipeline": {
"baseline_ms": 85.9,
"tolerance_pct": 20
},
"bench_compute_intsum": {
"baseline_ms": 86.64,
"tolerance_pct": 20
},
"bench_compute_collatz": {
"baseline_ms": 87.02,
"tolerance_pct": 20
},
"bench_list_sum_explicit": {
"baseline_ms": 88.95,
"tolerance_pct": 20
}
}
}