Calibration
VITA-Bench → MCP Atlas
MCP Atlas is estimated from VITA-Bench with a linear curve fitted on 7 models measured on both: y = 0.8169·x + 0.2579, R² = 0.39, cross-validated error 13.3 pp. It is used for 1 estimate.
| Estimated model | VITA-Bench | MCP Atlas | Source |
|---|---|---|---|
| DeepSeek V3.2 | 18.5% | 40.9% | estimated ± 13.3 pp, low confidence |
Fitted on
| Model | VITA-Bench | MCP Atlas |
|---|---|---|
| Claude Opus 4.5 | 23.3% | 42.3% |
| LongCat-Flash-Lite-Sparse | 21.7% | 45.6% |
| Qwen3.5 397B | 43.7% | 46.1% |
| Qwen3.6-35B-A3B | 35.6% | 62.8% |
| Qwen3.6 Plus | 44.3% | 48.2% |
| Qwen3.7 Max | 47.9% | 76.4% |
| Qwen3.7 Plus | 45.6% | 73.2% |