Calibration
Vals GPQA Diamond → GPQA Diamond
GPQA Diamond is estimated from Vals GPQA Diamond with a Michaelis–Menten + offset curve fitted on 23 models measured on both: y = 0.0000 + 2.0000·x / (1.08507 + x), R² = 0.67, cross-validated error 1.7 pp. It is used for 17 estimates.
| Estimated model | Vals GPQA Diamond | GPQA Diamond | Source |
|---|---|---|---|
| Claude Haiku 4.5 | 72.2% | 79.9% | estimated ± 1.7 pp, medium confidence |
| Claude Opus 4.7 | 90.2% | 90.8% | estimated ± 1.7 pp, high confidence |
| Claude Sonnet 5 | 88.9% | 90.1% | estimated ± 1.7 pp, high confidence |
| Gemini 3.1 Flash-Lite | 81.1% | 85.5% | estimated ± 1.7 pp, medium confidence |
| Gemini 3.5 Flash-Lite | 83.8% | 87.2% | estimated ± 1.7 pp, high confidence |
| Gemini 3 Flash | 87.9% | 89.5% | estimated ± 1.7 pp, high confidence |
| GLM-4.5 | 72.2% | 79.9% | estimated ± 1.7 pp, medium confidence |
| GLM-4.6 | 74.5% | 81.4% | estimated ± 1.7 pp, medium confidence |
| GLM-5.3 | 88.1% | 89.6% | estimated ± 1.7 pp, high confidence |
| GLM-5.3-Flash | 86.4% | 88.7% | estimated ± 1.7 pp, high confidence |
| Laguna M.1 | 27.0% | 39.9% | estimated ± 1.7 pp, medium confidence |
| Laguna XS.2 | 55.1% | 67.4% | estimated ± 1.7 pp, medium confidence |
| MiMo-V2.5 | 81.6% | 85.8% | estimated ± 1.7 pp, medium confidence |
| MiMo-V2.5-Pro | 82.6% | 86.4% | estimated ± 1.7 pp, medium confidence |
| MiniMax M3 | 92.7% | 92.1% | estimated ± 1.7 pp, high confidence |
| Mistral Medium 3.5 128B | 34.8% | 48.6% | estimated ± 1.7 pp, medium confidence |
| Qwen3.5 Flash | 82.8% | 86.6% | estimated ± 1.7 pp, medium confidence |