Calibration
HLE-Verified → AA-GPQA Diamond
AA-GPQA Diamond is estimated from HLE-Verified with a offset logistic curve fitted on 6 models measured on both: y = 0.9109 + (1.2000 − 0.9109) / (1 + exp(−24.43·(x − 0.6295))), R² = 0.81, cross-validated error 1.6 pp. It is used for 0 estimates.
Fitted on
| Model | HLE-Verified | AA-GPQA Diamond |
|---|---|---|
| Claude Opus 5 | 54.4% | 93.2% |
| Claude Sonnet 5 | 31.0% | 91.1% |
| Gemini 3.7 Flash | 53.6% | 94.5% |
| Gemini 3.8 Flash | 54.9% | 95.3% |
| GPT-5.6 Sol | 54.5% | 94.1% |
| GPT-5.6 Terra | 51.1% | 92.5% |