Score vs. cost per question
Upstage models in color, every other model in grey
Provider
2 models tested, compared with 76 models from other labs.
Upstage#49Solar Pro 445.0% verification score91 tok/s0.6 s first token$0.0018 / questionUpstage#54Solar Mini 441.2% verification score107 tok/s0.7 s first token$0.00053 / questionUpstage models in color, every other model in grey
Upstage models in color, every other model in grey
Upstage models highlighted against every model in this run · higher is better
Upstage models highlighted against every model in this run · higher is better
Upstage models highlighted against every model in this run · lower is better
Upstage models highlighted against every model in this run · lower is better
Upstage models highlighted against every model in this run · lower is better
Upstage models highlighted against every model in this run · higher is better
| # | ||||||||
|---|---|---|---|---|---|---|---|---|
| 1 | Solar Pro 4 Upstage · served by Upstage | 45.0 | 36 / 80 | 91 | 0.6 s | $0.0018 | $0.15 / $0.6 | 524k |
| 2 | Solar Mini 4 Upstage · served by Upstage | 41.2 | 33 / 80 | 107 | 0.7 s | $0.00053 | $0.05 / $0.2 | 524k |