Data as of · 78 models, 80 questions · reviewed by LLM Verifications team · methodology

Leaderboard

LLM leaderboard: AI models compared

78 AI models (LLMs) from 28 labs ranked on verification score, price, output speed (tokens per second), latency (time to first token) and context window. Score is the share of the suite's questions each model answered correctly. Cost per question is what OpenRouter billed, on average, reasoning tokens included. Click a column heading to sort.

LLM leaderboard

Leaderboard
#
1Claude Opus 5.5
Anthropic · served by Claude Platform on AWS
85.068 / 801292.3 s$0.015$4 / $201M
2Gemini 4 Argon
Google · served by Google
84.867 / 79693.3 s$0.0063$2 / $101M
3GPT-5.3-Codex
OpenAI · served by OpenAI
82.566 / 80951.4 s$0.01$1.75 / $14400k
4Gemini 3.8 Flash
Google · served by Google
82.566 / 801423.2 s$0.0037$0.825 / $4.1251M
5Claude Fable 5.1
Anthropic · served by Anthropic
81.265 / 80702.1 s$0.016$10 / $501M
6Grok 4.7
SpaceXAI · served by xAI
80.064 / 80771.9 s$0.025$2 / $6500k
7Muse Wonder
Meta · served by Meta
78.863 / 8017516.1 s$0.021$4 / $201M
8Claude Sonnet 5.5
Anthropic · served by Claude Platform on AWS
78.863 / 801260.7 s$0.0054$2 / $101M
9Gemini 3.1 Pro Preview
Google · served by Google
77.562 / 801243.4 s$0.017$2 / $121M
10Muse Spark Open
Meta · served by Together
77.562 / 802200.5 s$0.0045$1.25 / $4.251M
11Kimi K3.1 Pro
MoonshotAI · served by Moonshot AI
77.562 / 80381.3 s$0.01$2 / $101M
12GPT-6 Astra
OpenAI · served by OpenAI
76.261 / 80491.3 s$0.013$10 / $501.1M
13GPT-6.1 Terra Pro
OpenAI · served by OpenAI
76.261 / 80—8.5 s$0.005$1 / $51.1M
14GPT-6.1 Sol
OpenAI · served by OpenAI
76.261 / 80412.1 s$0.0029$2 / $101.1M
15GPT-5.6 Terra
OpenAI · served by OpenAI
75.060 / 801011.1 s$0.0063$2 / $121.1M
16Gemini 3.5 Flash Lite
Google · served by Google
75.060 / 804091.1 s$0.0034$0.3 / $2.51M
17Qwen3.8 Max (0902)
Qwen · served by Alibaba
75.060 / 80461.2 s$0.011$2 / $61M
18GPT-6.1 Terra
OpenAI · served by OpenAI
73.859 / 801222.4 s$0.0013$1 / $51.1M
19DeepSeek V4.1 Flash 1017
DeepSeek · served by Wafer
73.859 / 80570.9 s$0.00091$0.15 / $0.61M
20GPT-6 Sol
OpenAI · served by OpenAI
73.859 / 80920.9 s$0.0024$2 / $101.1M
21o3
OpenAI · served by OpenAI
72.558 / 801631.2 s$0.0088$2 / $8200k
22GPT-5.4
OpenAI · served by OpenAI
72.558 / 80551.7 s$0.011$2.5 / $151.1M
23GPT-6 Luna
OpenAI · served by OpenAI
72.558 / 801371.2 s$0.00025$0.1 / $0.51.1M
24DeepSeek V4 Flash Vision Exp
DeepSeek · served by DeepInfra
71.257 / 801700.7 s$0.0011$0.2156 / $0.64681M
25DeepSeek V4 Pro 0813
DeepSeek · served by Alibaba
71.257 / 80560.8 s$0.0036$1.32 / $3.961M
26Claude Haiku 5.5
Anthropic · served by Claude Platform on AWS
68.855 / 801920.7 s$0.00048$0.1 / $0.51M
27MiMo-V2.6-Pro
Xiaomi · served by DeepInfra
68.855 / 80580.7 s$0.002$0.435 / $0.871.1M
28GLM 5.3 Flash
Z.ai · served by Wafer
67.554 / 80830.5 s$0.00015$0.15 / $0.51M
29Inkling Small
Thinking Machines · served by DeepInfra
67.554 / 802330.5 s$0.00047$0.45 / $1.2524k
30GLM 5.3
Z.ai · served by Wafer
67.554 / 801540.8 s$0.00093$0.079 / $1.41M
31Inkling
Thinking Machines · served by Together
66.253 / 801180.6 s$0.0012$1 / $4.05524k
32MiniMax M3.1 Flash
MiniMax · served by InferenceNet
66.253 / 801310.5 s$0.00087$0.15 / $0.61M
33Kimi K2.7 Code
MoonshotAI · served by Inceptron
65.052 / 801360.4 s$0.006$0.56 / $3.1262k
34Step 5 Preview
StepFun · served by InferenceNet
63.851 / 80930.6 s$0.0047$1 / $2.71M
35Qwen3.8 27B
Qwen · served by Modal
63.851 / 80490.5 s$0.0043$0.2 / $2.51M
36MiMo-V2.6-Flash
Xiaomi · served by Relace
62.550 / 80770.4 s$0.00056$0.14 / $0.281.1M
37Qwen3 Coder Next
Qwen · served by Parasail
62.550 / 801060.4 s$0.0017$0.12 / $0.8262k
38Qwen3.7 Plus
Qwen · served by Alibaba
60.048 / 80621.1 s$0.0033$0.32 / $1.281M
39Nemotron 3 Ultra
NVIDIA · served by BaseTen
60.048 / 801360.8 s$0.0057$0.6 / $2.4262k
40Llama 4 Maverick
Meta · served by DigitalOcean
59.046 / 78130.7 s$0.00059$0.1875 / $0.6525524k
41Hy3
Tencent · served by Tencent
58.847 / 80961.7 s$0.0012$0.132 / $0.528262k
42gpt-oss-120b
OpenAI · served by CoreWeave
58.847 / 80820.5 s$0.00013$0.15 / $0.6131k
43Mercury 2.5
Inception · served by Inception
58.246 / 791572.3 s$0.00011$0.04 / $0.15260k
44Qwen3.8 2.4T A95B
Qwen · served by Venice
57.546 / 80443.1 s$0.015$2 / $61M
45MiniMax M3
MiniMax · served by CoreWeave
57.546 / 801210.5 s$0.0026$0.3 / $1.21M
46gpt-oss-20b
OpenAI · served by Darkbloom
51.241 / 801030.7 s$0.000066$0.018 / $0.09131k
47Mistral Large 4
Mistral · served by Mistral
50.040 / 80831.1 s$0.011$1.36 / $4.181M
48LongCat 2.0
Meituan · served by AtlasCloud
48.839 / 80671.4 s$0.0032$0.3 / $1.21M
49Command A
Cohere · served by Cohere
45.036 / 8071.8 s$0.007$2.5 / $10256k
50Solar Pro 4
Upstage · served by Upstage
45.036 / 80910.6 s$0.0018$0.15 / $0.6524k
51Nemotron 3.5 Lightning
NVIDIA · served by Io Net
43.835 / 801160.5 s$0.00049$0.07 / $0.2262k
52Ministral 3 8B 2512
Mistral · served by Mistral
42.534 / 801240.3 s$0.00027$0.15 / $0.15262k
53Llama 3.3 70B Instruct
Meta · served by DeepInfra
42.534 / 80420.7 s$0.00053$0.1 / $0.32131k
54Llama 4 Scout
Meta · served by DeepInfra
41.233 / 80151.2 s$0.00037$0.1 / $0.31.3M
55Ling 3.1 Flash
inclusionAI · served by Novita
41.233 / 8071.1 s$0.00061$0.075 / $0.225262k
56Phi 4
Microsoft · served by DeepInfra
41.233 / 801030.5 s$0.00012$0.07 / $0.1416k
57Solar Mini 4
Upstage · served by Upstage
41.233 / 801070.7 s$0.00053$0.05 / $0.2524k
58Nemotron 3.5 Super VL
NVIDIA · served by Darkbloom
40.032 / 807150.6 s$0.0013$0.15 / $0.51M
59Qwen3.6 35B A3B
Qwen · served by DeepInfra
37.530 / 801350.4 s$0.0037$0.1 / $0.95262k
60Granite 4.2 8B
IBM · served by DeepInfra
36.229 / 80600.6 s$0.000077$0.06 / $0.25131k
61Ministral 3 14B 2512
Mistral · served by Mistral
33.827 / 80320.6 s$0.00031$0.2 / $0.2262k
62Qwen3.5 397B A17B
Qwen · served by Phala
32.526 / 802400.6 s$0.013$0.5 / $3.6262k
63Mistral Small 4
Mistral · served by Mistral
32.526 / 801700.5 s$0.0019$0.15 / $0.6262k
64Gemma 4 31B
Google · served by CoreWeave
30.024 / 80580.6 s$0.0014$0.2 / $0.4262k
65Mistral Medium 3.5
Mistral · served by Mistral
28.823 / 801450.5 s$0.025$1.5 / $7.5262k
66Trinity Large Thinking
Arcee AI · served by Arcee AI
28.823 / 803290.6 s$0.0025$0.25 / $0.8262k
67Hermes 4 405B
Nous · served by Nebius
26.221 / 80410.3 s$0.01$1 / $3131k
68Ministral 3 3B 2512
Mistral · served by Mistral
26.221 / 802520.3 s$0.00019$0.1 / $0.1131k
69Granite 4.0 Micro
IBM · served by Cloudflare
25.020 / 80380.7 s$0.000051$0.017 / $0.112131k
70Nova Micro 1.0
Amazon · served by Amazon Bedrock
22.518 / 801800.5 s$0.000087$0.035 / $0.14128k
71Gemma 4 26B A4B
Google · served by Darkbloom
15.012 / 801720.7 s$0.0011$0.09 / $0.3262k
72Reka Flash 3
rekaai · served by Reka
1.21 / 801010.5 s$0.0008$0.1 / $0.266k
73LFM2.5-2.6B—0 / 0———$0.35 / $0.5128k
74Ling 3.0 Flash VL—0 / 0———$0.06 / $0.18131k
75Qwen3.5-122B-A10B
Qwen · served by SiliconFlow
—0 / 01081.2 s—$0.4 / $3.2262k
76Qwen3 Next 80B A3B Thinking—0 / 0———$0.15 / $1.2262k
77Nova Premier 1.0—0 / 0———$2.5 / $12.51M
78GPT-5.5 Pro
OpenAI · served by OpenAI
—0 / 0—33.8 s—$30 / $1801.1M