benchgap
Calibration

ARC-AGI-3 → GPQA Diamond

GPQA Diamond is estimated from ARC-AGI-3 with a linear curve fitted on 14 models measured on both: y = 0.0616·x + 0.9255, R² = 0.47, cross-validated error 1.8 pp. It is used for 1 estimate.

Estimated modelARC-AGI-3GPQA DiamondSource
Claude Fable 5.265.7%96.6%estimated ± 1.8 pp, medium confidence

Fitted on

ModelARC-AGI-3GPQA Diamond
Claude Opus 4.60.5%89.2%
Claude Opus 4.70.2%94.2%
Claude Opus 4.81.5%93.6%
Gemini 3.1 Pro0.4%94.3%
GPT-5.40.2%92.8%
GPT-5.50.4%93.6%
GPT-5.6 Luna0.2%92.3%
GPT-5.6 Sol7.8%94.6%
GPT-5.6 Terra0.8%92.9%
GPT-6.2 Astra70.3%97.0%
GPT-6.2 Sol54.9%96.0%
GPT-6 Astra62.7%96.0%
Grok 4.200.1%88.5%
Inkling 2 Small0.3%93.0%