benchgap
Calibration

AA Agentic Index → HLE w/ tools

HLE w/ tools is estimated from AA Agentic Index with a linear curve fitted on 10 models measured on both: y = 0.4780·x + 0.3503, R² = 0.57, cross-validated error 6.7 pp. It is used for 0 estimates.

Fitted on

ModelAA Agentic IndexHLE w/ tools
Claude Opus 556.2%64.7%
Claude Sonnet 544.3%57.4%
DeepSeek V4 Flash 073141.7%45.1%
DeepSeek V4 Pro49.6%60.0%
GLM-5.125.2%52.3%
GLM-5.239.4%54.7%
GLM-5.353.4%62.5%
GPT-6 Astra51.5%57.2%
Nemotron 3 Ultra21.7%37.4%
Qwen3.7 Max23.9%53.5%