Rapid-MLX vs Ollama vs LM Studio on Apple Silicon

Three good ways to run local models on a Mac. Here's where each one fits — plus a reproducible benchmark so you can fill in the speed numbers on your own machine, not take ours on faith.

If you run local models on a Mac, you've probably landed on one of three tools: Ollama, LM Studio, or Rapid-MLX. All three are good. They optimize for different things, so the honest answer to "which is fastest / best?" is it depends on your Mac, your model, and what you're wiring it into. This page lays out where each one fits, shows the rapid-mlx numbers we've actually measured — and then hands you a benchmark you can run yourself, because a speed number we recorded on our Mac Studio won't predict what you'll see on yours.

Where each one fits

Rapid-MLX Ollama LM Studio
Backend Pure MLX — Apple-native kernels llama.cpp (GGUF) llama.cpp + MLX, GUI
API surface OpenAI and Anthropic (/v1/messages) OpenAI-compatible + native /api OpenAI-compatible
Interface CLI + server CLI + server GUI-first + server
Platforms macOS / Apple Silicon only macOS · Windows · Linux macOS · Windows · Linux
License Apache-2.0 MIT Proprietary (free app)
Model catalog 191 curated aliases large large (Hugging Face GGUF)
Best for Fast Apple-Silicon serving + coding agents Cross-platform, breadth of models GUI users, browsing models by hand

Read that as three honest lanes, not a scoreboard:

If you're on a Mac and wiring a local model into a coding agent, rapid-mlx is the tightest fit. If you need to leave the Mac, or you want a GUI, the other two are genuinely better for that.

How fast is Rapid-MLX? (measured)

Here are decode speeds we've actually recorded, single-stream, on a Mac Studio:

Model Size on disk Decode tok/s
qwen3.5-4b-4bit 2.4 GB 158
qwen3.5-9b-4bit 5.1 GB 106
gpt-oss-20b-mxfp4-q8 12.1 GB 124
gemma-4-26b-4bit 14.7 GB 110
qwen3.5-35b-a3b-8bit 36.9 GB 80

All rapid-mlx figures are single-request wall-clock measurements on an Apple M3 Ultra (256 GB), macOS 26.5.2, from 2026-07 evaluation runs. tok/s includes TTFT and is not comparable across quantization levels or architectures. On a laptop, derate: an M4 Max lands around 0.6–0.7× of Studio, an M4 Pro around 0.4–0.5×, base M-series lower — memory bandwidth is the ceiling. See the full 17-model benchmark for the methodology and accuracy scores.

Run the comparison yourself

Here's the part most comparison posts skip: we haven't run a same-machine head-to-head against Ollama and LM Studio, so we're not going to print a "2–4× faster" bar we can't reproduce. Cross-engine speed swings with the exact model, quant, prompt length, and your Mac's thermal state — a number from our Studio tells you almost nothing about your M2 Air. The only comparison that's true for you is the one you run on your Mac. It takes about five minutes.

Pick the closest matching model in each tool (they won't be byte-identical quants — that's fine, note it), use the same prompt, and run each twice, reading the second (warm) run.

Rapid-MLX — the canonical single-stream benchmark:

rapid-mlx bench qwen3.5-9b-4bit
# prints decode tok/s, prefill tok/s, and TTFT.
# add --submit to publish your row to rapidmlx.com/performance (CC0)

Ollama--verbose prints the eval rate:

ollama run qwen2.5:7b --verbose "Write a 200-word explanation of how a transformer works."
# read the "eval rate: NN tokens/s" line it prints after the response

LM Studio — load a comparable model, then either read the tok/s readout in the chat UI after a generation, or start its local server and time a request. The lms CLI also exposes model info if you prefer the terminal.

Now you have three real numbers, on one machine, for one model — the honest version of "which is fastest." If you get a reproducible result, send it our way — we'll fold community comparisons into the performance page.

Which should you pick?

And the boats-unburned option: the servers listen on different ports (rapid-mlx :8000, Ollama :11434), so you can run them side by side and move one tool over at a time. Nothing forces the choice.

Where to go next


Run this yourself. rapid-mlx is an open-source, OpenAI-compatible inference server for Apple Silicon. pip install rapid-mlx, then rapid-mlx serve <alias>. Browse every supported model on the family docs or pick one by your Mac's RAM at models.rapidmlx.com.