Changelog / release
0.10.5 — Fix batch
Released 2026-07-08 · full changelog · GitHub releases
- Spec-decode unified interface migration. Legacy
_install_mtpinstaller removed (−475 LOC dead code) — every MTP path now flows through the vendored installer that was already the live runtime.mtp_optimisticis hard-rejected at all three entry points (SchedulerConfig.__post_init__,server.load_model, CLI normalizer) so misuse fails loud instead of silently ignoring the flag.spec_decode='suffix'is preserved as a canonical value;mtp_max_kconflict detection is now idempotent for the disabled default. Matched-vendored bench on Qwen3.6-27B-4bit + MTP sidecar (90 requests × 3 runs) confirmed behavior parity: tok/s median 43.83 → 46.03 (+5.0% noise), MTP rounds 17704 → 17619 (0.5% delta), finish reasons 59/31 → 60/30 (PR #1050). - README trim. Slimmed from 1142 → ~280 lines. Each trimmed section carries a → link to the specific docs page anchor instead of losing content silently (PR #1054).
- install.sh Tier-1 refresh.
RECOMMENDED_MODELnow maps to the 0.10 Tier-1 families (gpt-oss-120b · qwen3.6-35b-a3b · gpt-oss-20b · qwen3.5-4b fallback). Canonical URLs migrated torapidmlx.comacross the script (PR #1053). - HF → R2 mirror tool. New
scripts/mirror_to_r2.pyhandles streaming multipart mirrors of gated / large model weights (used to seed gpt-oss-120b MXFP4-Q8 and Qwen3.6-{27,35}B-MTP-4bit into R2). Bench / maintenance tooling only, not a runtime dependency (PR #1056). - OpenHands integration harness. Corrected the gpt-oss XFAIL reason (CodeActAgent parses text-action XML tags; gpt-oss emits harmony analysis + final channels — the format mismatch, not a stop-scoping bug). Docker digest handling in the harness now uses a two-ref pattern that avoids the OpenHands 0.9.0
base_image.split(':')bug on 3-way digest tags (PR #1055, tracked upstream at All-Hands-AI/OpenHands#15167).