Calibration

Vals MMLU-Pro → Vals GPQA Diamond

Name: benchgap: LLM benchmark scores, measured and estimated
Creator: benchgap

Vals GPQA Diamond is estimated from Vals MMLU-Pro with a Hill curve fitted on 55 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.73519^6.00 + x^6.00), R² = 0.77, cross-validated error 3.8 pp. It is used for 1 estimate.

Estimated model	Vals MMLU-Pro	Vals GPQA Diamond	Source
Muse Spark 1.2	88.3%	90.0%	estimated ± 3.8 pp, high confidence