benchgap
Calibration

MCP Atlas → Toolathlon-Verified

Toolathlon-Verified is estimated from MCP Atlas with a linear curve fitted on 12 models measured on both: y = 0.9519·x + -0.0706, R² = 0.60, cross-validated error 8.8 pp. It is used for 2 estimates.

Estimated modelMCP AtlasToolathlon-VerifiedSource
Ripple-65B Preview71.7%61.2%estimated ± 8.8 pp, medium confidence
LLaDA2.2-flash46.2%36.9%estimated ± 8.8 pp, low confidence

Fitted on

ModelMCP AtlasToolathlon-Verified
Claude Opus 585.8%80.6%
DeepSeek V4 Flash 073169.0%70.3%
DeepSeek V4 Pro73.6%74.1%
ERNIE 5.5 Flash Preview84.6%75.0%
Hy4 preview83.7%74.1%
Inkling-Small79.6%54.4%
Kimi K384.2%73.2%
Muse Spark Open89.2%72.8%
Ornith-1.5-35B-A3B70.2%48.7%
Ornith-1.5-397B80.0%71.2%
Ornith-1.5-9B54.2%41.2%
Step 5 Preview85.6%74.1%