Choose between Rapid-MLX, Ollama and LM Studio
Three good ways to run local models on a Mac. Here's where each one fits — plus a reproducible benchmark so you can fill in the speed numbers on your own machine, not take ours on faith.
Choose Rapid-MLX for an Apple Silicon server and coding agents, Ollama for a cross-platform model library, or LM Studio for a graphical model browser and chat app. The best speed depends on your Mac, model and workload. This guide compares their features and shows how to test them on your machine.
For the measured MLX vs Ollama head-to-head, including Ollama's cold-prompt advantage, see the Rapid-MLX vs Ollama benchmark.
A newer comparison (September 2026) adds oMLX and mlx-lm and measures Rapid-MLX, oMLX, Ollama and mlx-lm on one Mac, with raw data (LM Studio is in its feature table only): Rapid-MLX vs oMLX vs Ollama vs LM Studio vs mlx-lm, with focused pages for oMLX and Ollama.
Where each one fits
| Rapid-MLX | Ollama | LM Studio | |
|---|---|---|---|
| Backend | Pure MLX — Apple-native kernels | llama.cpp (GGUF) | llama.cpp + MLX, GUI |
| API surface | OpenAI and Anthropic (/v1/messages) |
OpenAI-compatible + native /api |
OpenAI-compatible |
| Interface | CLI + server | CLI + server | GUI-first + server |
| Platforms | macOS / Apple Silicon only | macOS · Windows · Linux | macOS · Windows · Linux |
| License | Apache-2.0 | MIT | Proprietary (free app) |
| Model catalog | 215 curated aliases (at v0.11.5) | large | large (Hugging Face GGUF) |
| Best for | Fast Apple-Silicon serving + coding agents | Cross-platform, breadth of models | GUI users, browsing models by hand |
Read that as three honest lanes, not a scoreboard:
- Ollama is the one to keep if you need Windows or Linux, or a specific model that isn't in the rapid-mlx catalog. Its library is larger and it's the de-facto standard — that's a real advantage, not a footnote.
- LM Studio is the pick if you want a polished GUI to browse, download, and chat with models without touching a terminal. It also runs on Windows/Linux.
- Rapid-MLX is built narrowly for Apple Silicon: pure MLX kernels (no llama.cpp fallback), and it's the only one of the three that speaks the Anthropic API (
/v1/messages) as well as OpenAI — which is what lets Claude Code point at a local model. Apache-2.0, CLI-and-server, Mac-only.
If you're on a Mac and wiring a local model into a coding agent, rapid-mlx is the tightest fit. If you need to leave the Mac, or you want a GUI, the other two are genuinely better for that.
How fast is Rapid-MLX? (measured)
Here are decode speeds we've actually recorded, single-stream, on a Mac Studio:
| Model | Size on disk | Decode tok/s |
|---|---|---|
qwen3.5-4b-4bit |
2.4 GB | 158 |
qwen3.5-9b-4bit |
5.1 GB | 106 |
gpt-oss-20b-mxfp4-q8 |
12.1 GB | 124 |
gemma-4-26b-4bit |
14.7 GB | 110 |
qwen3.5-35b-a3b-8bit |
36.9 GB | 80 |
All rapid-mlx figures are single-request wall-clock measurements on an Apple M3 Ultra (256 GB), macOS 26.5.2, from 2026-07 evaluation runs. tok/s includes TTFT and is not comparable across quantization levels or architectures. On a laptop, derate: an M4 Max lands around 0.6–0.7× of Studio, an M4 Pro around 0.4–0.5×, base M-series lower — memory bandwidth is the ceiling. See the full 17-model benchmark for the methodology and accuracy scores.
Run the comparison yourself
Our measured benchmark compares the engines on one Mac. Cross-engine speed still changes with the model, quantization, prompt length and your Mac, so test your own workload too. This quick comparison takes about five minutes.
Pick the closest matching model in each tool (they won't be byte-identical quants — that's fine, note it), use the same prompt, and run each twice, reading the second (warm) run.
Rapid-MLX — the canonical single-stream benchmark:
rapid-mlx bench qwen3.5-9b-4bit # prints decode tok/s, prefill tok/s, and TTFT. # add --submit to publish your row to rapidmlx.com/performance (CC0)
Ollama — --verbose prints the eval rate:
ollama run qwen2.5:7b --verbose "Write a 200-word explanation of how a transformer works." # read the "eval rate: NN tokens/s" line it prints after the response
LM Studio — load a comparable model, then either read the tok/s readout in the chat UI after a generation, or start its local server and time a request. The lms CLI also exposes model info if you prefer the terminal.
Now you have three real numbers, on one machine, for one model — the honest version of "which is fastest." If you get a reproducible result, send it our way — we'll fold community comparisons into the performance page.
Which should you pick?
- Mac + a coding agent (Claude Code, Cursor, Codex) + you want speed → Rapid-MLX. The Anthropic API surface and pure-MLX kernels are exactly what this workflow needs, and
rapid-mlx launch claude-codewires it up in one command. - You need Windows/Linux, or a model outside the catalog → Ollama. Don't fight it — it's the right tool for cross-platform and breadth.
- You want a GUI to browse and chat, no terminal → LM Studio.
And the boats-unburned option: the servers listen on different ports (rapid-mlx :8000, Ollama :11434), so you can run them side by side and move one tool over at a time. Nothing forces the choice.
Where to go next
- Moving from Ollama to rapid-mlx — the command + model-name cheat sheet, if you're switching.
- Run Claude Code on a local model — the Anthropic-API workflow rapid-mlx is built for.
- The 17-model M3 Ultra benchmark — full methodology behind the numbers above.
- Install rapid-mlx — one curl, or Homebrew. Apache 2.0.
rapid-mlx serve <alias> serves any model on
localhost:8000/v1.
curl -fsSL https://rapidmlx.com/install.sh | bash
New models and speedups, in your inbox
A short note whenever Rapid-MLX gets faster or adds models worth running on your Mac. No spam — unsubscribe anytime.