Calibration
AIME26 → MATH-500
MATH-500 is estimated from AIME26 with a linear curve fitted on 5 models measured on both: y = 0.1364·x + 0.8468, R² = 0.69, cross-validated error 3.1 pp. It is used for 24 estimates.
| Estimated model | AIME26 | MATH-500 | Source |
|---|---|---|---|
| A.X K2 | 97.1% | 97.9% | estimated ± 3.1 pp, low confidence |
| Claude Opus 4.5 | 95.1% | 97.7% | estimated ± 3.1 pp, medium confidence |
| Gemma 4 12B | 77.5% | 95.2% | estimated ± 3.1 pp, medium confidence |
| GLM-5 | 95.8% | 97.7% | estimated ± 3.1 pp, medium confidence |
| GLM-5.1 | 95.3% | 97.7% | estimated ± 3.1 pp, medium confidence |
| GLM-5.2 | 99.2% | 98.2% | estimated ± 3.1 pp, low confidence |
| Inkling | 97.1% | 97.9% | estimated ± 3.1 pp, low confidence |
| Inkling-Small | 95.5% | 97.7% | estimated ± 3.1 pp, medium confidence |
| K-EXAONE 2.0 | 92.3% | 97.3% | estimated ± 3.1 pp, medium confidence |
| Kimi K2.6 | 96.4% | 97.8% | estimated ± 3.1 pp, low confidence |
| Kimi K2.5 | 95.8% | 97.7% | estimated ± 3.1 pp, medium confidence |
| Ling 3.0 Flash | 93.2% | 97.4% | estimated ± 3.1 pp, medium confidence |
| LLaDA2.2-mini | 35.1% | 89.5% | estimated ± 3.1 pp, low confidence |
| MAI-Thinking-1 | 94.5% | 97.6% | estimated ± 3.1 pp, medium confidence |
| Muse Glimmer 30B | 94.7% | 97.6% | estimated ± 3.1 pp, medium confidence |
| Qwen3.5 397B | 93.3% | 97.4% | estimated ± 3.1 pp, medium confidence |
| Qwen3.6-27B | 94.1% | 97.5% | estimated ± 3.1 pp, medium confidence |
| Qwen3.6-35B-A3B | 92.7% | 97.3% | estimated ± 3.1 pp, medium confidence |
| Qwen3.6 Plus | 95.3% | 97.7% | estimated ± 3.1 pp, medium confidence |
| Beam | 97.8% | 98.0% | estimated ± 3.1 pp, low confidence |
| Solar Open 2 | 95.7% | 97.7% | estimated ± 3.1 pp, medium confidence |
| Solar Pro 4 | 95.3% | 97.7% | estimated ± 3.1 pp, medium confidence |
| ZAYA1-74B-Preview | 76.4% | 95.1% | estimated ± 3.1 pp, medium confidence |
| ZAYA1-8B | 89.1% | 96.8% | estimated ± 3.1 pp, medium confidence |