give gpt_oss_120b the safe (flag-dont-guess) system prompt #18

Merged
claude merged 2 commits from worktree-swap-default-prompt into main 2026-07-18 14:43:03 +02:00

2 Commits

Author SHA1 Message Date
claude 65a84655a9 docs(analyze): refresh DEFAULT_SYSTEM_PROMPT doc-comments after prompt swap
The doc-comments still described the old permissive prompt (the c414cf52
sandbox validation, the "AKTIVE KORREKTUR" rationale, the old block layout).
Rewrite them to describe the current "flag, don't guess" prompt and to note
that DEFAULT_SYSTEM_PROMPT and LLAMA_SYSTEM_PROMPT are now content-identical.
2026-07-18 14:42:30 +02:00
claude 1a87c6b5ea fix(analyze): give gpt_oss_120b the safe (flag-don't-guess) system prompt
Replace default_system_prompt.md with the llama prompt content. The default
backend (gpt_oss_120b) carries all real traffic, but used the permissive
prompt that lets the model SUBSTITUTE dictated terms with its own guess;
the llama prompt keeps the dictated word and only flags it for review.

Validated in the experiments sandbox against 16 real alpha-test cases
(full pipeline: pre-gazetteer -> gpt_oss_120b -> post-gazetteer, 3 runs
each, independently judged): dangerous-error rate per run drops from
44% (20/45) to 10% (5/49), and the 3 runs that produced no output at all
(reasoning length-exhaustion) drop to 0.

The two prompt files are now content-identical, as backend.rs already
anticipated. Follow-up: the DEFAULT_SYSTEM_PROMPT doc-comment in
analyze/backend.rs still describes the old prompt and should be refreshed.
2026-07-17 23:38:41 +02:00