0.12.10 — A 131K-context reasoner on an 8 GB Mac

Released 2026-08-11 · full changelog · GitHub releases

Upgrade: pip install -U rapid-mlx · brew upgrade rapid-mlx · or grab the desktop app.

inclusionAI’s Ling-3.0-tiny gets the first MLX conversion anywhere and ships served natively — a 7.9B mixture-of-experts reasoner with 1.3B active parameters that fits an 8 GB Mac. Underneath: MoE experts can stream from disk, the scheduler fails loudly instead of hanging clients, and auth fails closed.

Ling-3.0-tiny is served natively. rapid-mlx serve ling-3.0-tiny-4bit runs inclusionAI’s 7.9B-total / 1.3B-active sparse-MoE reasoner (128 experts, top-8 plus one shared, KDA + MLA hybrid attention, 131K context, MIT) through a vendored bailing_hybrid backbone verified against the official modeling code on identical weights (#1817). Thinking streams as reasoning_content — toggled by enable_thinking or the model’s detailed thinking on/off switch — and tool calls parse natively in both stream modes. The 4-bit conversion (4.2 GB) is the first MLX conversion of this architecture anywhere, published under the rapid-mlx org on Hugging Face and mirrored on the model CDN (#1819, #1826).
MoE experts can stream from disk. --disk-stream streams routed-expert weights from disk instead of holding every expert resident (#1803).
Scheduler errors fail loudly. An engine error mid-batch now fails the in-flight requests instead of leaving their clients hanging (#1810).
Auth fails closed. An empty companion key or a duplicated x-api-key header is rejected instead of slipping through (#1811).
The desktop app gets a unified Settings surface. Settings UI and menu-bar branding are reworked into one coherent surface (#1828), and the CLI’s RAM-tier model recommendations are now shared with the Mac app so both surfaces suggest the same models for your machine (#1832).
Desktop paper cuts. Downloads report honestly and web tools are hardened (#1813); cached-model defaults are chosen quality-aware (#1805); onboarding is clearer and first-launch catalog probes are gated (#1804, #1816); third-party license texts ship inside the .app bundle (#1812); Markdown tables read correctly under VoiceOver (#1822, #1824); and native XCUITest pixel coverage joins the desktop test stack (#1820).
Release infrastructure. Installer checksums are version-stamped so cosign signing is idempotent (#1821), the mlx-compat import-order contract is restored in bailing_hybrid with its guard test green (#1823), and two order-dependent full-suite flakes are gone (#1830).

@loriz-art — unified macOS Settings UI and menu-bar branding (#1828)
@MIt9 — --disk-stream for MoE routed-expert weights (#1803)