0.12.1 — A desktop app, and a Gemma 4 page that was quoting numbers nobody measured

Released 2026-08-03 · full changelog · GitHub releases

• A menu-bar Mac app, in the open-source repo. apps/rapid-mac is an Ollama-style local-LLM app under Apache 2.0 — the same engine with a one-click interface, download-only, with the rapid-mlx name reserved for the engine itself (PRs #1406, #1413, #1427).
• The Gemma 4 26B page was quoting fabricated speculative-decoding numbers. They were replaced with measured ones, alongside a corrected MoE flag and a serve guide sized for a 32 GB Mac (PR #1429). A companion recipe covers Gemma 4 12B on an 18 GB Mac (PR #1423).
• SuffixDecoding is no longer a tax on traffic it does not suit. Its floor on free-form generation went from −32% to −6.7% (gemma-4-12b-4bit, M3 Pro) with the code-edit win intact, and M2 Pro’s high-overlap case moved from exactly 1.00× to +13%. It still does not clear the bar for defaulting on, so it stays opt-in — the point is that turning it on is no longer a gamble (PR #1419).
• Gemma 4 gets live KV quantization, a working bench path, and an exposed KV-projection override (PR #1408).
• Long-context prefill adapts to memory pressure instead of pushing through it (PR #1410).
• pip install rapid-mlx[all] now installs an audio stack that actually works — the extra was pulling a combination that had never been validated together (PR #1421).
• mlx / mlx-lm / mlx-vlm version bounds are capped, and moving one is gated on a full-family output-coherence sweep. An upstream heuristic change had previously shipped garbage generations (issue #1248, PR #1400).
• Community benchmarks submit over HTTP rather than by opening a GitHub PR (PR #1403).
• Codex and DeepSeek V4 engineering turns are steadier — bounded action priming, evidence-aware retries, recovery when a test command is unavailable, and a hardened DSML tool protocol (PRs #1402, #1407, #1417, #1418, #1424, #1428).