benchgap
Calibration

SuperGPQA → GPQA Diamond

GPQA Diamond is estimated from SuperGPQA with a Michaelis–Menten + offset curve fitted on 7 models measured on both: y = 0.0000 + 1.8609·x / (0.82112 + x), R² = 0.87, cross-validated error 12.9 pp. It is used for 2 estimates.

Estimated modelSuperGPQAGPQA DiamondSource
Seed 2.1 Pro70.8%86.2%estimated ± 12.9 pp, low confidence
Seed 2.1 Turbo67.4%83.9%estimated ± 12.9 pp, low confidence

Fitted on

ModelSuperGPQAGPQA Diamond
Claude Opus 4.695.0%89.2%
GLM-566.8%86.0%
Kimi K2.569.2%87.6%
MiniCPM5-1B23.1%26.3%
MiniCPM5-2B40.8%70.2%
Qwen3.7 Max73.6%92.4%
Qwen3.7 Plus71.4%90.3%