Verdict
Built from the measurements below
- Gemma 4 31B is more accurate: 30.0% against 15.0% on the same 80 questions, a 15.0-point gap that is statistically significant.
- Gemma 4 26B A4B is 1.3× cheaper per question as billed ($0.0011 vs $0.0014), reasoning tokens included.
- Gemma 4 26B A4B generates text 2.9× faster: 172 tokens per second against 58.
Which should you choose?
Choose Gemma 4 26B A4B for faster streaming and more hosts to choose from on OpenRouter (15 against 13). Choose Gemma 4 31B for the most accurate answers of the two and the lower cost per correct answer ($0.0046 against $0.0072). The widest subject gap is in humanities & social science: Gemma 4 31B answered 5 of 9 correctly, Gemma 4 26B A4B 2 of 9. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.
Accuracy gap -15.0 points (z = -2.27). We call a winner only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.