Brummel
72e54f4fd3
The surface-form file extension changes from .ailx to .ail. AILang's
authoring surface now uses the same .ail stem as its canonical JSON
form (.ail.json), giving the language a single coherent extension
family: .ail is the LLM-authored Form A, .ail.json is the canonical
JSON-AST Form B.
Scope (touched):
- 61 example renames examples/**/*.ailx → .ail (git mv)
- 1 rename experiments/.../rendered/ailx.md → ail.md
- 35 content-edited live-toolchain files (crates/, docs/DESIGN.md,
docs/roadmap.md, docs/PROSE_ROUNDTRIP.md, skills/, bench/reference/*.c,
experiment crates under experiments/.../{render,harness,master})
- Experiment-crate cohort rename Cohort::Ailx → Cohort::Ail,
Form::Ailx → Form::Ail, per_cohort/ailx → per_cohort/ail,
{form-only: ailx} → {form-only: ail}, ```ailx → ```ail
Out of scope (deliberately untouched, to preserve honest history):
- docs/journal-archive.md (content-frozen per CLAUDE.md)
- docs/journals/, docs/specs/, docs/plans/, bench/orchestrator-stats/
- experiments/.../runs/ (frozen LLM-output artefacts; models actually
saw .ailx — renaming would falsify the experimental record)
Verification: cargo build/test --workspace green; experiment crate
cargo test green; bench/check.py + compile_check.py + cross_lang.py
all 0-regressed; negative grep for ailx|Ailx|AILX outside the
out-of-scope paths returns zero matches.
Opens immediate follow-up: roadmap.md P2 todo `ail check`/build/run
accept .ail extension — after this rename, .ail is canonical
authoring surface but the CLI still produces a misleading JSON-parse
error on `ail check foo.ail`. That's the next iter.
47 lines
1.7 KiB
Rust
47 lines
1.7 KiB
Rust
//! Token-balance gate for master/spec.md form-only blocks.
|
|
//!
|
|
//! The mini-spec is the experimental treatment; if the JSON-cohort's
|
|
//! form-only scaffolding is meaningfully longer than the AIL-cohort's
|
|
//! (or vice versa), the experiment is biased before the model ever
|
|
//! sees the prompts. This test catches gross imbalance.
|
|
|
|
use std::path::PathBuf;
|
|
use xmodel_render::splitter::{self, Form, Segment};
|
|
|
|
fn master_dir() -> PathBuf {
|
|
let manifest = PathBuf::from(env!("CARGO_MANIFEST_DIR"));
|
|
manifest.parent().unwrap().join("master")
|
|
}
|
|
|
|
#[test]
|
|
fn form_only_block_token_totals_within_five_percent() {
|
|
let spec_text = std::fs::read_to_string(master_dir().join("spec.md"))
|
|
.expect("master/spec.md must exist");
|
|
let segments = splitter::split(&spec_text);
|
|
|
|
let mut json_buf = String::new();
|
|
let mut ail_buf = String::new();
|
|
for seg in &segments {
|
|
if let Segment::FormOnly { form, body } = seg {
|
|
match form {
|
|
Form::Json => json_buf.push_str(body),
|
|
Form::Ail => ail_buf.push_str(body),
|
|
}
|
|
}
|
|
}
|
|
|
|
let bpe = tiktoken_rs::cl100k_base().expect("cl100k_base tokenizer should load");
|
|
let json_count = bpe.encode_with_special_tokens(&json_buf).len();
|
|
let ail_count = bpe.encode_with_special_tokens(&ail_buf).len();
|
|
assert!(json_count > 0, "JSON-form blocks produced zero tokens");
|
|
assert!(ail_count > 0, "AIL-form blocks produced zero tokens");
|
|
|
|
let max = json_count.max(ail_count) as f64;
|
|
let diff = (json_count as i64 - ail_count as i64).unsigned_abs() as f64;
|
|
let ratio = diff / max;
|
|
assert!(
|
|
ratio <= 0.05,
|
|
"form-only block token imbalance: json={json_count}, ail={ail_count}, ratio={ratio:.4} > 0.05",
|
|
);
|
|
}
|