Ranking
Median output tokens per second after the first token, over repeated streamed runs of the same prompt. Models that deliver the whole answer in one burst after hidden thinking are left out. Top 15 of 72.
| # | Model | Speed (tok/s) | First token | Score | Cost / question |
|---|---|---|---|---|---|
| 1 | NVIDIA | 715 | 0.6 s | 40.0% | $0.0013 |
| 2 | 409 | 1.1 s | 75.0% | $0.0034 | |
| 3 | Arcee AI | 329 | 0.6 s | 28.8% | $0.0025 |
| 4 | Mistral | 252 | 0.3 s | 26.2% | $0.00019 |
| 5 | Qwen | 240 | 0.6 s | 32.5% | $0.013 |
| 6 | Thinking Machines | 233 | 0.5 s | 67.5% | $0.00047 |
| 7 | Meta | 220 | 0.5 s | 77.5% | $0.0045 |
| 8 | Anthropic | 192 | 0.7 s | 68.8% | $0.00048 |
| 9 | Amazon | 180 | 0.5 s | 22.5% | $0.000087 |
| 10 | Meta | 175 | 16.1 s | 78.8% | $0.021 |
| 11 | 172 | 0.7 s | 15.0% | $0.0011 | |
| 12 | Mistral | 170 | 0.5 s | 32.5% | $0.0019 |
| 13 | DeepSeek | 170 | 0.7 s | 71.2% | $0.0011 |
| 14 | OpenAI | 163 | 1.2 s | 72.5% | $0.0088 |
| 15 | Inception | 157 | 2.3 s | 58.2% | $0.00011 |