Calibration
AA Agentic Index → HLE w/ tools
HLE w/ tools is estimated from AA Agentic Index with a linear curve fitted on 10 models measured on both: y = 0.4780·x + 0.3503, R² = 0.57, cross-validated error 6.7 pp. It is used for 0 estimates.
Fitted on
| Model | AA Agentic Index | HLE w/ tools |
|---|---|---|
| Claude Opus 5 | 56.2% | 64.7% |
| Claude Sonnet 5 | 44.3% | 57.4% |
| DeepSeek V4 Flash 0731 | 41.7% | 45.1% |
| DeepSeek V4 Pro | 49.6% | 60.0% |
| GLM-5.1 | 25.2% | 52.3% |
| GLM-5.2 | 39.4% | 54.7% |
| GLM-5.3 | 53.4% | 62.5% |
| GPT-6 Astra | 51.5% | 57.2% |
| Nemotron 3 Ultra | 21.7% | 37.4% |
| Qwen3.7 Max | 23.9% | 53.5% |