Choose between Rapid-MLX, Ollama and LM Studio

Three good ways to run local models on a Mac. Here's where each one fits — plus a reproducible benchmark so you can fill in the speed numbers on your own machine, not take ours on faith.

Choose Rapid-MLX for an Apple Silicon server and coding agents, Ollama for a cross-platform model library, or LM Studio for a graphical model browser and chat app. The best speed depends on your Mac, model and workload. This guide compares their features and shows how to test them on your machine.

For the measured MLX vs Ollama head-to-head, including Ollama's cold-prompt advantage, see the Rapid-MLX vs Ollama benchmark.

A newer comparison (September 2026) adds oMLX and mlx-lm and measures Rapid-MLX, oMLX, Ollama and mlx-lm on one Mac, with raw data (LM Studio is in its feature table only): Rapid-MLX vs oMLX vs Ollama vs LM Studio vs mlx-lm, with focused pages for oMLX and Ollama.

Where each one fits

Rapid-MLX Ollama LM Studio
Backend Pure MLX — Apple-native kernels llama.cpp (GGUF) llama.cpp + MLX, GUI
API surface OpenAI and Anthropic (/v1/messages) OpenAI-compatible + native /api OpenAI-compatible
Interface CLI + server CLI + server GUI-first + server
Platforms macOS / Apple Silicon only macOS · Windows · Linux macOS · Windows · Linux
License Apache-2.0 MIT Proprietary (free app)
Model catalog 215 curated aliases (at v0.11.5) large large (Hugging Face GGUF)
Best for Fast Apple-Silicon serving + coding agents Cross-platform, breadth of models GUI users, browsing models by hand

Read that as three honest lanes, not a scoreboard:

If you're on a Mac and wiring a local model into a coding agent, rapid-mlx is the tightest fit. If you need to leave the Mac, or you want a GUI, the other two are genuinely better for that.

How fast is Rapid-MLX? (measured)

Here are decode speeds we've actually recorded, single-stream, on a Mac Studio:

Model Size on disk Decode tok/s
qwen3.5-4b-4bit 2.4 GB 158
qwen3.5-9b-4bit 5.1 GB 106
gpt-oss-20b-mxfp4-q8 12.1 GB 124
gemma-4-26b-4bit 14.7 GB 110
qwen3.5-35b-a3b-8bit 36.9 GB 80

All rapid-mlx figures are single-request wall-clock measurements on an Apple M3 Ultra (256 GB), macOS 26.5.2, from 2026-07 evaluation runs. tok/s includes TTFT and is not comparable across quantization levels or architectures. On a laptop, derate: an M4 Max lands around 0.6–0.7× of Studio, an M4 Pro around 0.4–0.5×, base M-series lower — memory bandwidth is the ceiling. See the full 17-model benchmark for the methodology and accuracy scores.

Run the comparison yourself

Our measured benchmark compares the engines on one Mac. Cross-engine speed still changes with the model, quantization, prompt length and your Mac, so test your own workload too. This quick comparison takes about five minutes.

Pick the closest matching model in each tool (they won't be byte-identical quants — that's fine, note it), use the same prompt, and run each twice, reading the second (warm) run.

Rapid-MLX — the canonical single-stream benchmark:

rapid-mlx bench qwen3.5-9b-4bit
# prints decode tok/s, prefill tok/s, and TTFT.
# add --submit to publish your row to rapidmlx.com/performance (CC0)

Ollama — --verbose prints the eval rate:

ollama run qwen2.5:7b --verbose "Write a 200-word explanation of how a transformer works."
# read the "eval rate: NN tokens/s" line it prints after the response

LM Studio — load a comparable model, then either read the tok/s readout in the chat UI after a generation, or start its local server and time a request. The lms CLI also exposes model info if you prefer the terminal.

Now you have three real numbers, on one machine, for one model — the honest version of "which is fastest." If you get a reproducible result, send it our way — we'll fold community comparisons into the performance page.

Which should you pick?

And the boats-unburned option: the servers listen on different ports (rapid-mlx :8000, Ollama :11434), so you can run them side by side and move one tool over at a time. Nothing forces the choice.

Where to go next


Run this yourself. Rapid-MLX is an open-source, OpenAI- and Anthropic-compatible inference server for Apple Silicon. One command installs it, then rapid-mlx serve <alias> serves any model on localhost:8000/v1.
curl -fsSL https://rapidmlx.com/install.sh | bash

New models and speedups, in your inbox

A short note whenever Rapid-MLX gets faster or adds models worth running on your Mac. No spam — unsubscribe anytime.