benchgap
Calibration

HLE-Verified → AA-GPQA Diamond

AA-GPQA Diamond is estimated from HLE-Verified with a offset logistic curve fitted on 6 models measured on both: y = 0.9109 + (1.2000 − 0.9109) / (1 + exp(−24.43·(x − 0.6295))), R² = 0.81, cross-validated error 1.6 pp. It is used for 0 estimates.

Fitted on

ModelHLE-VerifiedAA-GPQA Diamond
Claude Opus 554.4%93.2%
Claude Sonnet 531.0%91.1%
Gemini 3.7 Flash53.6%94.5%
Gemini 3.8 Flash54.9%95.3%
GPT-5.6 Sol54.5%94.1%
GPT-5.6 Terra51.1%92.5%