8d9fd22bdc11438274d4432a20b528870b48fac6
German practice software (INDAMED MEDICAL OFFICE) stores free text in ISO 8859-15, an 8-bit code. Pasting our cleaned document there rendered typographic Unicode the LLM emits — en-/em-dashes, curly quotes, ellipses, fraction slashes — as replacement boxes, while umlauts, the micro sign, guillemets and the euro sign (all within 8859-15) pasted fine. The KBV xDT data standard confirms ISO 8859-15 as the canonical charset for German practice systems. Add `analyze::charset::fold_to_iso8859_15`, applied in the worker right after the gazetteer and before `content_md` is persisted: representable chars pass through verbatim, the residual is transliterated via the `deunicode` table (en-dash -> '-', ellipsis -> '...', '1/2' -> "1/2"), and unmapped chars are left untouched rather than dropped. Because representable chars never reach deunicode, its ASCII-only nature does not flatten umlauts or the micro sign. refs #13
Description
No description provided
Languages
Rust
74%
Kotlin
12.7%
HTML
4.9%
Python
4.1%
Shell
3.8%
Other
0.5%