Changelog / release
0.8.19
Released 2026-06-25 · full changelog · GitHub releases
- Tmax-27B hybrid-cache fix.
is_hybrid: trueon all Tmax-27B variants — was incorrectlyfalsein 0.8.18, which corrupted the RNN state on prefix-cache hits (PR #902). - Responses item shape defaults to
type: "message"when role+content are present (PR #904). - thinking accounting.
enable_thinkingnow threads into prompt accounting on the chat + responses paths so reasoning models report token usage correctly (PR #906, follow-up to #891). - Auto-config routing. V4 / V5 model-type detection aligned with the alias classifier (PR #903).
- CLI:
rapid-mlx servenow exits non-zero on a port-already-in-use error (PR #905). - CI: pr_validate full_unit flakes on macOS uv-managed Python fixed (PR #907).