Benchmarks · community-measured
qwen3.8-27b-mixed-3.5bpw on Apple M4 Pro
Real measured local-inference performance for
qwen3.8-27b-mixed-3.5bpw on an Apple M4 Pro (48 GB unified memory),
from the rapid-mlx community benchmark corpus. Headline submission
2026-08-27, measured on rapid-mlx 0.13.1.
15.9
tok/s decode
115
tok/s prefill
18.6 s
first token
17.3 GB
peak memory
A single community run so far — treat it as one data point, not a distribution. Reproduce it below and submit yours to firm it up.
All measurements for this pair
| RAM | Accel | Decode | Prefill | TTFT | Peak mem | Runs | rapid-mlx | Latest |
|---|---|---|---|---|---|---|---|---|
| 48 GB | — | 15.9 tok/s | 115 tok/s | 18.6 s | 17.3 GB | 1 | 0.13.1 | 2026-08-27 |
Standardized single-request benchmark: 5 measured rounds after 1 discarded warmup, greedy sampling, prefix cache disabled. Raw corpus: /api/benchmarks.
Reproduce this number
Install rapid-mlx, run the same suite on your Mac, and submit the result — it lands on the community leaderboard and updates this page.
curl -fsSL https://rapidmlx.com/install.sh | bash
rapid-mlx bench qwen3.8-27b-mixed-3.5bpw --tier speed --submit