0.11.3 — Audio grows up, and video ships

Released 2026-07-30 · full changelog · GitHub releases

The largest single jump in the model registry so far: 191 → 214 aliases. Eleven new TTS/STT aliases, eight video-generation aliases, and a whole new modality behind an asynchronous jobs API. Version 0.11.2 was cut but never released: its Tier-1 agent gate failed. 0.11.3 is 0.11.2 plus a first attempt at the fix (PR #1341) — and its gate failed too. The defects turned out to be in the gate harness itself, not in the release payload: the harness ran the Hermes setup without --base-url, leaving its context at the 32K fallback below the 64K minimum Hermes requires to start at all, and its per-agent time budget was too tight for the 35B hybrid gate model's cold shader compile. The payload was then verified by hand on the Studio (M3 Ultra) — Claude Code, Codex and Aider pass, and Hermes passes once its context is set correctly — and 0.11.3 shipped through the documented emergency-release path, with the bypass and its reason stamped into the GitHub release notes. The harness has since been fixed.

• Video generation, a new lane. POST /v1/videos follows OpenAI's job-based Videos API — submit, poll, download the MP4. Three backends ship: Wan 2.1 / 2.2 with four converted checkpoints, native frame-rate handling, 4n+1 temporal-shape enforcement, per-checkpoint pixel-area ceilings and LoRA support (PR #1322); CogVideoX-Fun with its runtime bundled so no source checkout is needed (PR #1313, #1329); and MLX-native LTX-2.3 (PR #1298). Jobs are serialized on purpose — two diffusion pipelines resident at once will exhaust unified memory. Needs Python 3.11+ and ffmpeg; core text and audio stay on 3.10 (PR #1325). See the video family page.
• Voice cloning, four ways. Qwen3-TTS Base clones from a reference clip plus its transcript, so a channel can keep one branded narrator (PR #1305). IndexTTS 1.5 clones from the clip alone — no transcript — which makes it the least fiddly path (PR #1318). F5-TTS (pure MLX, no torch) closes the Chinese expressive-cloning gap that Qwen3-TTS reads flat on and Chatterbox can't reach, being English-only (PR #1297, #1304). Chatterbox gained zero-shot cloning and an exaggeration control (PR #1303).
• Qwen3-TTS VoiceDesign — describe a voice instead of picking one. Timbre, gender, age, accent, emotion and prosody all come from a natural-language instructions string; there are no named speakers at all. That is a strictly richer surface than CustomVoice's instructions, which only modulates a fixed speaker (PR #1309).
• Forced alignment — timings without recognition error. Give Qwen3-ForcedAligner audio plus the transcript you already have and it returns per-character start/end times. Because it never guesses at words, it cannot mis-hear them — which is exactly what karaoke captions and beat-synced editing need, and it was unoccupied on MLX (PR #1301). The lane was then hardened: blocking work moved off the event loop, the aligner given its own model cache so it stops evicting the ASR model, and corrupted uploads no longer misreported as bad requests (PR #1317, #1327).
• SenseVoice — fast Asian-language ASR. FunAudioLLM SenseVoice Small (~234M, non-autoregressive CTC), strongest in the registry on Chinese, Cantonese, Japanese and Korean, and it emits per-segment emotion and audio-event tags alongside the transcript (PR #1308).
• Word-level timestamps on transcription. /v1/audio/transcriptions now returns per-word timings (PR #1299).
• Local text-to-music. A vendored MLX Stable Audio 3 engine behind POST /v1/audio/music (PR #1307, #1316).
• Kokoro stops taking the worker down. A broken espeak G2P setup used to crash the audio worker or return 500s and crowd out other candidates; it now degrades and reports instead (PR #1312, #1314). VoxCPM's advertised Chinese support was withdrawn — it did not work, and claiming it was worse than not having it (PR #1302).
• Release gating got stricter and better calibrated. A KV-quant differential quality gate with a chip-tier classifier (PR #1289), DeepSeek-R1 excluded from the coherence sweep where it was a known false positive (PR #1324), the Hermes gauntlet profile stabilized (PR #1330), and the G12 random-coverage gate recalibrated (PR #1332).
• Dead code removed. The unused vLLM platform prototype (PR #1288), unused cloud routing (PR #1290) and legacy branding on public surfaces (PR #1292) are gone. rapid-mlx models now shows download size per model (PR #1293).