Arena leaderboard
Compare model speed and blind votes from Smol for Mac.
Live speed
Hosted launcher requests, timed at the Smol Worker. Includes single-pass attempts with or without web search.
Loading live results…
How speed is measured
Smol’s Worker measures from provider dispatch to the first and last visible answer chunks. The Mac also measures delivery to your device for single-model replies. The 95th percentile (p95) shows how long the slowest 5% took to reach that point. Timings use completed answers. Completion rate includes stopped and failed attempts. Turns that needed desktop tool follow-ups are excluded. Search and length filters require reported usage. Delivery counts reported output tokens over the visible streaming interval. A dash means a metric has too few eligible observations.
One-search benchmark
The same lookup and fixed-length answer on all 14 models, fastest median finish first. Nov 3, 2026 · Five OpenRouter runs per model with one basic search. tok/s counts visible delivery in reference tokens. Buffered text can arrive in bursts.
| Model | First text | Delivery | Finish ↑ |
|---|---|---|---|
| DeepSeek V4.1 Flash 1017 | 1.90 s | 234 tok/s | 3.06 s |
| Claude Sonnet 5.5 | 3.54 s | 3,205 tok/s | 3.58 s |
| Claude Haiku 5.5 | 3.26 s | 233 tok/s | 3.79 s |
| Grok 4.7 | 3.38 s | 207 tok/s | 3.88 s |
| GLM 5.3 Prime | 3.63 s | 196 tok/s | 4.29 s |
| GPT-6 Luna | 3.77 s | 152 tok/s | 4.30 s |
| Muse Spark Open | 1.07 s | 485 tok/s | 5.49 s |
| GPT-6.1 Terra | 5.27 s | 197 tok/s | 6.00 s |
| Claude Opus 5.5 | 7.07 s | 4,595 tok/s | 7.10 s |
| GPT-6.1 Sol | 6.67 s | 234 tok/s | 7.68 s |
| Muse Wonder | 7.67 s | 386 tok/s | 8.02 s |
| Kimi K3.1 Pro | 12.87 s | 62 tok/s | 14.92 s |
| Muse Spark 1.3 | 4.99 s | 270 tok/s | 15.50 s |
| Muse Glimmer 30B | 14.68 s | 67 tok/s | 18.51 s |