benchgap
Calibration

HLE w/ tools → Toolathlon-Verified

Toolathlon-Verified is estimated from HLE w/ tools with a Michaelis–Menten + offset curve fitted on 13 models measured on both: y = 0.0000 + 2.0000·x / (1.01358 + x), R² = 0.80, cross-validated error 5.9 pp. It is used for 1 estimate.

Estimated modelHLE w/ toolsToolathlon-VerifiedSource
Agents-A147.6%63.9%estimated ± 5.9 pp, medium confidence