Summary
- Answers 46 of 79 verification questions correctly (58.2%), placing #43 of 72 models tested on the current suite.
- Generates 157 output tokens per second, faster than 80% of the models we measure.
- Starts responding after 2.3 s (median time to first token), including thinking time.
- Costs $0.00011 per question as billed, #5 cheapest of 12 models priced under $0.15 per 1M tokens.