benchgap
Calibration

SkillsBench → MCP Atlas

MCP Atlas is estimated from SkillsBench with a Michaelis–Menten curve fitted on 5 models measured on both: y = 1.3343·x / (0.39369 + x), R² = 0.75, cross-validated error 6.6 pp. It is used for 2 estimates.

Estimated modelSkillsBenchMCP AtlasSource
Qwen3.8 Max70.2%85.5%estimated ± 6.6 pp, low confidence
Atria Dawn Preview66.4%83.8%estimated ± 6.6 pp, low confidence

Fitted on

ModelSkillsBenchMCP Atlas
Hy4 preview62.9%83.7%
Ling 3.0 Flash44.8%65.5%
Ling 3.1 Flash68.7%83.0%
LongCat-2.563.3%83.1%
Muse Glimmer 30B44.3%75.5%