benchgap
Calibration

Toolathlon-Verified → WideResearch

WideResearch is estimated from Toolathlon-Verified with a Michaelis–Menten curve fitted on 6 models measured on both: y = 1.4847·x / (0.57158 + x), R² = 0.91, cross-validated error 3.9 pp. It is used for 5 estimates.

Estimated modelToolathlon-VerifiedWideResearchSource
GLM-5.3-Flash78.4%85.9%estimated ± 3.9 pp, low confidence
Claude Fable 5.177.8%85.6%estimated ± 3.9 pp, low confidence
Claude Opus 5.577.8%85.6%estimated ± 3.9 pp, low confidence
Claude Sonnet 5.577.8%85.6%estimated ± 3.9 pp, low confidence
Laguna S 2.149.7%69.1%estimated ± 3.9 pp, medium confidence

Fitted on

ModelToolathlon-VerifiedWideResearch
dots3-note Preview55.6%78.9%
Hy4 preview74.1%83.9%
Ornith-1.5-35B-A3B48.7%67.8%
Ornith-1.5-397B71.2%80.8%
Ornith-1.5-9B41.2%59.5%
Qwen3.8 Max72.5%81.9%