Ranking
The cost–accuracy frontier: each model listed scores higher than every model that costs less per question. Ordered from cheapest to most accurate.
| # | Model | Cost / question | Score | Cost / correct answer | Speed (tok/s) |
|---|---|---|---|---|---|
| 1 | IBM | $0.000051 | 25.0% | $0.0002 | 38 |
| 2 | OpenAI | $0.000066 | 51.2% | $0.00013 | 103 |
| 3 | Inception | $0.00011 | 58.2% | $0.00019 | 157 |
| 4 | OpenAI | $0.00013 | 58.8% | $0.00021 | 82 |
| 5 | Z.ai | $0.00015 | 67.5% | $0.00022 | 83 |
| 6 | OpenAI | $0.00025 | 72.5% | $0.00034 | 137 |
| 7 | DeepSeek | $0.00091 | 73.8% | $0.0012 | 57 |
| 8 | OpenAI | $0.0029 | 76.2% | $0.0037 | 41 |
| 9 | $0.0037 | 82.5% | $0.0045 | 142 | |
| 10 | $0.0063 | 84.8% | $0.0074 | 69 | |
| 11 | Anthropic | $0.015 | 85.0% | $0.017 | 129 |