Summary
- Answers 18 of 80 verification questions correctly (22.5%), placing #70 of 72 models tested on the current suite.
- Generates 180 output tokens per second, faster than 89% of the models we measure.
- Starts responding after 0.5 s (median time to first token).
- Costs $0.000087 per question as billed, #4 cheapest of 12 models priced under $0.15 per 1M tokens.