benchgap
Calibration

MCP Atlas → APEX-Agents

APEX-Agents is estimated from MCP Atlas with a linear curve fitted on 6 models measured on both: y = 1.0709·x + -0.4636, R² = 0.64, cross-validated error 12.6 pp. It is used for 9 estimates.

Estimated modelMCP AtlasAPEX-AgentsSource
Inkling 2 Small85.0%44.7%estimated ± 12.6 pp, low confidence
Beam 1.0 501B-A23B FP881.5%40.9%estimated ± 12.6 pp, low confidence
Beam 1.0 501B-A23B NVFP480.5%39.8%estimated ± 12.6 pp, low confidence
Ling 3.0 Flash Sante75.6%34.6%estimated ± 12.6 pp, low confidence
Spark-X2.6-4B62.4%20.5%estimated ± 12.6 pp, low confidence
Nemotron 3.5 Bolt 74B-A9B BF1655.6%13.2%estimated ± 12.6 pp, low confidence
LLaDA2.2-flash46.2%3.1%estimated ± 12.6 pp, low confidence
LongCat-Flash-Lite-Sparse45.6%2.5%estimated ± 12.6 pp, low confidence
Claude Opus 4.542.3%0.0%estimated ± 12.6 pp, low confidence

Fitted on

ModelMCP AtlasAPEX-Agents
ERNIE 5.5 Flash Preview84.6%64.2%
Hy4 preview83.7%37.1%
Kimi K384.2%37.6%
Solar Open 258.2%16.6%
Solar Pro 461.4%18.7%
Step 5 Preview85.6%37.8%