Changelog / release
0.10.8 — HY3 native MTP (opt-in self-speculative decoding)
Released 2026-07-11 · full changelog · GitHub releases
- HY3 native MTP — opt-in self-speculative decoding. Hunyuan 3's built-in 3.8B MTP head (a DeepSeek-V3-style prediction layer that the 4-bit conversion had stripped) is re-extracted into a sidecar and wired into the vendored spec-decode installer, giving HY3 factory-trained self-speculative drafting with no separate draft model (PR #1094). It is off by default — enable per serve with
--force-spec-decode --speculative-config '{"method":"mtp"}'. On M3 Ultra the head currently measures roughly break-even-to-slightly-slower on decode throughput (draft accept ~52–74% at K=3 doesn't overcome the per-step draft + verify cost), so plain autoregressive decode stays the default and recommended path.