Calibration
MCP Atlas → Toolathlon-Verified
Toolathlon-Verified is estimated from MCP Atlas with a linear curve fitted on 12 models measured on both: y = 0.9519·x + -0.0706, R² = 0.60, cross-validated error 8.8 pp. It is used for 2 estimates.
| Estimated model | MCP Atlas | Toolathlon-Verified | Source |
|---|---|---|---|
| Ripple-65B Preview | 71.7% | 61.2% | estimated ± 8.8 pp, medium confidence |
| LLaDA2.2-flash | 46.2% | 36.9% | estimated ± 8.8 pp, low confidence |
Fitted on
| Model | MCP Atlas | Toolathlon-Verified |
|---|---|---|
| Claude Opus 5 | 85.8% | 80.6% |
| DeepSeek V4 Flash 0731 | 69.0% | 70.3% |
| DeepSeek V4 Pro | 73.6% | 74.1% |
| ERNIE 5.5 Flash Preview | 84.6% | 75.0% |
| Hy4 preview | 83.7% | 74.1% |
| Inkling-Small | 79.6% | 54.4% |
| Kimi K3 | 84.2% | 73.2% |
| Muse Spark Open | 89.2% | 72.8% |
| Ornith-1.5-35B-A3B | 70.2% | 48.7% |
| Ornith-1.5-397B | 80.0% | 71.2% |
| Ornith-1.5-9B | 54.2% | 41.2% |
| Step 5 Preview | 85.6% | 74.1% |