Calibration
MCP Atlas → APEX-Agents
APEX-Agents is estimated from MCP Atlas with a linear curve fitted on 6 models measured on both: y = 1.0709·x + -0.4636, R² = 0.64, cross-validated error 12.6 pp. It is used for 9 estimates.
| Estimated model | MCP Atlas | APEX-Agents | Source |
|---|---|---|---|
| Inkling 2 Small | 85.0% | 44.7% | estimated ± 12.6 pp, low confidence |
| Beam 1.0 501B-A23B FP8 | 81.5% | 40.9% | estimated ± 12.6 pp, low confidence |
| Beam 1.0 501B-A23B NVFP4 | 80.5% | 39.8% | estimated ± 12.6 pp, low confidence |
| Ling 3.0 Flash Sante | 75.6% | 34.6% | estimated ± 12.6 pp, low confidence |
| Spark-X2.6-4B | 62.4% | 20.5% | estimated ± 12.6 pp, low confidence |
| Nemotron 3.5 Bolt 74B-A9B BF16 | 55.6% | 13.2% | estimated ± 12.6 pp, low confidence |
| LLaDA2.2-flash | 46.2% | 3.1% | estimated ± 12.6 pp, low confidence |
| LongCat-Flash-Lite-Sparse | 45.6% | 2.5% | estimated ± 12.6 pp, low confidence |
| Claude Opus 4.5 | 42.3% | 0.0% | estimated ± 12.6 pp, low confidence |
Fitted on
| Model | MCP Atlas | APEX-Agents |
|---|---|---|
| ERNIE 5.5 Flash Preview | 84.6% | 64.2% |
| Hy4 preview | 83.7% | 37.1% |
| Kimi K3 | 84.2% | 37.6% |
| Solar Open 2 | 58.2% | 16.6% |
| Solar Pro 4 | 61.4% | 18.7% |
| Step 5 Preview | 85.6% | 37.8% |