benchgap
Calibration

APEX-Agents → HLE w/ tools

HLE w/ tools is estimated from APEX-Agents with a Michaelis–Menten curve fitted on 6 models measured on both: y = 0.7124·x / (0.10792 + x), R² = 0.42, cross-validated error 6.3 pp. It is used for 1 estimate.

Estimated modelAPEX-AgentsHLE w/ toolsSource
Solar Open 216.6%43.2%estimated ± 6.3 pp, low confidence

Fitted on

ModelAPEX-AgentsHLE w/ tools
Apodex 1.138.5%56.1%
dots3-note Preview30.8%52.6%
Hy475.2%59.1%
Hy4 flash63.1%55.2%
Hy4 preview37.1%55.4%
Kimi K3.1 Pro69.4%70.0%