benchgap
Calibration

Artificial Analysis Intelligence Index → AA-GPQA Diamond

AA-GPQA Diamond is estimated from Artificial Analysis Intelligence Index with a Hill curve fitted on 181 models measured on both: y = 0.0000 + (0.9452 − 0.0000)·x^1.75 / (0.06219^1.75 + x^1.75), R² = 0.86, cross-validated error 6.8 pp. It is used for 5 estimates.

Estimated modelArtificial Analysis Intelligence IndexAA-GPQA DiamondSource
Claude 4.1 Opus18.6%82.4%estimated ± 6.8 pp, medium confidence
GPT-4 Turbo7.0%52.4%estimated ± 6.8 pp, medium confidence
MiMo-V2.6-Flash37.9%90.7%estimated ± 6.8 pp, medium confidence
MiMo-V2.6-Pro46.3%91.8%estimated ± 6.8 pp, medium confidence
Mistral Large 438.4%90.8%estimated ± 6.8 pp, medium confidence