Verdict
Built from the measurements below
- Accuracy is too close to call: Llama 4 Maverick scored 59.0% and Qwen3.7 Plus 60.0% on the same 78 questions, a gap within what chance alone could produce.
- Llama 4 Maverick is 5.5× cheaper per question as billed ($0.00059 vs $0.0033), reasoning tokens included.
- Qwen3.7 Plus generates text 4.7× faster: 62 tokens per second against 13.
- Llama 4 Maverick starts answering sooner: 0.7 s to the first token, against 1.1 s for Qwen3.7 Plus.
- Qwen3.7 Plus accepts more context: 1M tokens against 524k.
Which should you choose?
Choose Llama 4 Maverick for the lower cost per correct answer ($0.001 against $0.0054), a quicker first token, shorter outputs (about 784 tokens per question against 2,462), open weights you can run yourself and more hosts to choose from on OpenRouter (3 against 1). Choose Qwen3.7 Plus for faster streaming and a 1M-token context window. The widest subject gap is in humanities & social science: Qwen3.7 Plus answered 9 of 9 correctly, Llama 4 Maverick 7 of 9. With so few questions per subject, treat this as a lead to test on your own prompts, not a result.
Accuracy gap -1.0 points (z = -0.13). We call a winner only when z is at least 1.96, the usual 95% threshold. Speed, latency and price need a 10% margin.