Summary
- Answers 55 of 80 verification questions correctly (68.8%), placing #26 of 72 models tested on the current suite.
- Generates 192 output tokens per second, faster than 90% of the models we measure.
- Starts responding after 0.7 s (median time to first token), including thinking time.
- Costs $0.00048 per question as billed, #8 cheapest of 29 models priced $0.15 to $1 per 1M tokens.