Summary
- Answers 66 of 80 verification questions correctly (82.5%), placing #3 of 72 models tested on the current suite.
- Generates 142 output tokens per second, faster than 76% of the models we measure.
- Starts responding after 3.2 s (median time to first token), including thinking time.
- Costs $0.0037 per question as billed, #6 cheapest of 31 models priced over $1 per 1M tokens.