Score vs. cost per question
IBM models in color, every other model in grey
Provider
2 models tested, compared with 76 models from other labs.
IBM models in color, every other model in grey
IBM models in color, every other model in grey
IBM models highlighted against every model in this run · higher is better
IBM models highlighted against every model in this run · higher is better
IBM models highlighted against every model in this run · lower is better
IBM models highlighted against every model in this run · lower is better
IBM models highlighted against every model in this run · lower is better
IBM models highlighted against every model in this run · higher is better
| # | ||||||||
|---|---|---|---|---|---|---|---|---|
| 1 | Granite 4.2 8B IBM · served by DeepInfra | 36.2 | 29 / 80 | 60 | 0.6 s | $0.000077 | $0.06 / $0.25 | 131k |
| 2 | Granite 4.0 Micro IBM · served by Cloudflare | 25.0 | 20 / 80 | 38 | 0.7 s | $0.000051 | $0.017 / $0.112 | 131k |