Changelog / release
0.10.7 — Long-run OOM fix, Hunyuan 3 + Liquid
Released 2026-07-10 · full changelog · GitHub releases
Community contributors: @66Ton99 — idle Responses SSE heartbeats (#1061); @MaXoS-Agent and @wparuch — Apple M2 Max community benchmarks (#1065, #1068); @ShiroKSH — TurboQuant Metal packaging (#1086).
- Long-run Metal OOM fixed. The scheduler no longer caches non-trimmable GatedDeltaNet recurrent state in the reuse cache, so long-lived / high-concurrency sessions stop leaking Metal memory and eventually hitting an OOM. The load-bearing stability win of the release (PR #1075, fixes #1025 and the #1058 leak).
- Hunyuan 3 (HY3) — new vendor family (Ultra-only preview). Day-one support for Tencent's Hunyuan 3, a 295B-total / 21B-active MoE with a 3.8B MTP head. Ultra-only: peak resident memory is ~156 GB, so it requires an M3 Ultra with 256 GB unified memory and will not fit smaller Macs. Alias
hy3-preview-4bit(4-bit MLX) with a dedicatedhy_v3tool-call + reasoning parser (PR #1070). - Tool-call parser coverage expansion. New parser families so tool-calling works across more of the catalog: LiquidAI LFM2.x (
lfm), Mistral / Devstral / Ministral (mistral), DeepSeek-Coder-V2-Lite (deepseek_v3), and NVIDIA Nemotron (fail-open). Ported from the vLLM / SGLang reference parsers rather than hand-rolled.