benchgap
Calibration

Toolathlon-Verified → HLE w/ tools

HLE w/ tools is estimated from Toolathlon-Verified with a linear curve fitted on 13 models measured on both: y = 0.8269·x + -0.0279, R² = 0.79, cross-validated error 5.9 pp. It is used for 2 estimates.

Estimated modelToolathlon-VerifiedHLE w/ toolsSource
Laguna S 2.149.7%38.3%estimated ± 5.9 pp, medium confidence
Qwen3.8-Flash-Next73.5%58.0%estimated ± 5.9 pp, medium confidence