Gemini 4 Pro (Leaked Benchmark) vs Qwen 4 Max (Leaked Staging)
A direct, empirical evaluation of Gemini 4 Pro (Leaked Benchmark) (Google DeepMind) against Qwen 4 Max (Leaked Staging) (Alibaba Cloud).
Gemini 4 Pro (Leaked Benchmark)
Developed by Google DeepMind · Proprietary Omni-Modal Unified Diffusion Transformer parameters
Repository-scale 2M-token refactoring (88.7% DeepSWE v1.1), headless shell execution (95.3% Terminal-Bench 2.1), and multimodal desktop agent autonomy (86.8% OSWorld 2.0).
Qwen 4 Max (Leaked Staging)
Developed by Alibaba Cloud · 1.2 Trillion (Sparse MoE) parameters
Repository-scale software engineering outscoring GPT-6 Sol, multilingual enterprise agents across 120 languages, and low-cost 1M-token processing.
| Metric | Gemini 4 Pro (Leaked Benchmark) | Qwen 4 Max (Leaked Staging) |
|---|---|---|
| SWE-bench Verified | 88.7% | 78.6% |
| MMLU-Pro | 93.8% | 91.4% |
| MATH-500 | 97.8% | 95.6% |
| Context Window | 2,000,000 tokens | 1,000,000 tokens |
| Input Pricing (per 1M) | $2.25 | $1.20 |
| Output Pricing (per 1M) | $11.25 | $4.80 |