Commit Graph

4 Commits

Author SHA1 Message Date
Brummel 83d3a52df7 Add hotwords form field to whisper service
Hotwords give per-request logit boosts to specified terms throughout
decoding (not just as prefix context like initial_prompt). Measured on
a cardiology dictation: 8/8 correct fachbegriffe vs. 3/8 without.
2026-04-14 00:22:36 +02:00
Brummel 8a19fc370d Add deploy script for whisper service
Syncs whisper/ to a remote host via rsync, rebuilds the image in place,
and polls /health until the model is loaded or a 5 minute timeout hits.
2026-04-13 22:31:52 +02:00
Brummel 5f961bd9b6 Bump faster-whisper to 1.2.1 for large-v3-turbo support
The 1.0.x line predates the turbo model; pin to latest stable (1.2.1).
2026-04-13 22:27:47 +02:00
Brummel 6e6cfd77b7 Add custom faster-whisper service with anti-hallucination params
Off-the-shelf Whisper wrappers hardcode faster-whisper defaults that
cause cascading hallucinations on real dictations (2/13 runs against
ahmetoner v1.9.1). This thin FastAPI service mirrors the /asr interface
but fixes condition_on_previous_text=False, temperature=0.0, and
vad_filter=True so the Axum server can switch by changing WHISPER_URL.
2026-04-13 19:45:52 +02:00