0.12.18 — Branch your chat, run more models

Released 2026-08-21 · full changelog · GitHub releases

Upgrade: pip install -U rapid-mlx · brew upgrade rapid-mlx · or grab the desktop app.

Regenerating an answer no longer throws the old one away — every alternative stays a switchable branch. This release also widens the catalog (LTX-2.5 video, Qwen Image, Ternary Bonsai 8B, North-Mini-Code, GPT-OSS Puzzle), makes dictation start hot, speeds up MoE decode, and hardens multimodal serving.

Regenerating an answer keeps the old one. Regenerate, Retry, and prompt edits now preserve every alternative as a switchable branch — step between them with the ‹ 2/3 › control under the bubble. Deleting a turn tells you exactly how many turns it removes, each fork remembers where you left off, and old conversations load unchanged (#2147).
Dictation starts hot. The catalog lookup and lazy weight load that used to land inside the first dictation of a session now run at enable / model-pick time — a 30-second clip lands in well under half a second once warm, and the Dictation tab attributes slow runs (“model 1.2 s · asr 0.3 s”) (#2152).
Faster MoE decode. Expert gate+up projections are fused into a single gather_qmm launch (#2151), and GDN prompt prefill gets a blocked-seq Metal kernel (#2144); GatedDeltaNet input projections fuse into one quantized matmul (#2159).
New models. LTX-2.5 video generation (#2158), Qwen Image through mflux (#2157), Ternary Bonsai 8B (#2162), North-Mini-Code (Cohere2-MoE, with a dedicated reasoning parser so chain-of-thought stops leaking into content) (#1223, #2171), and GPT-OSS Puzzle checkpoints (#1224).
Speculative decoding stays under your control. Tested model families expose experimental MTP presets in the desktop (#2173), and advanced users can opt into structurally compatible target/drafter pairs even when Rapid does not recommend them by default (#2177) — capability and recommendation stay separate, so an experimental path never silently becomes the default.
Safer multimodal serving. Remote and local media inputs are validated against SSRF and arbitrary-file-read paths before the VLM loader sees them (#2167). Gemma 4 checkpoints with stale embedded chat templates are upgraded to the shipped compatible template at load time.
SVG code blocks render a preview — offscreen, never on the network (#2148).
Mac & CLI polish. Background update progress is visible again (#2129), WON’T FIT rows open a read-only Review (#2131), a fresh install can quit before choosing telemetry (#2178); agents sizes its name column to the widest alias (#2139), and a flaky update-check response no longer crashes rapid-mlx upgrade (#2168).

@osdodo — switchable answer branches for Regenerate, Retry and prompt edits (#2147)