Calibration
Vals MMLU-Pro → GPQA Diamond
GPQA Diamond is estimated from Vals MMLU-Pro with a linear curve fitted on 23 models measured on both: y = 0.9065·x + 0.1177, R² = 0.59, cross-validated error 2.0 pp. It is used for 1 estimate.
| Estimated model | Vals MMLU-Pro | GPQA Diamond | Source |
|---|---|---|---|
| Muse Spark 1.2 | 88.3% | 91.8% | estimated ± 2.0 pp, high confidence |