Calibration
Toolathlon-Verified → MazeBench
MazeBench is estimated from Toolathlon-Verified with a linear curve fitted on 10 models measured on both: y = 1.2724·x + -0.9156, R² = 0.61, cross-validated error 4.0 pp. It is used for 5 estimates.
| Estimated model | Toolathlon-Verified | MazeBench | Source |
|---|---|---|---|
| DeepSeek V4 Pro 0813 | 74.1% | 2.7% | estimated ± 4.0 pp, high confidence |
| Hy4 preview | 74.1% | 2.7% | estimated ± 4.0 pp, high confidence |
| Step 5 Preview | 74.1% | 2.7% | estimated ± 4.0 pp, high confidence |
| Qwen3.8-Flash-Next | 73.5% | 2.0% | estimated ± 4.0 pp, high confidence |
| Ornith-1.5-397B | 71.2% | 0.0% | estimated ± 4.0 pp, high confidence |
Fitted on
| Model | Toolathlon-Verified | MazeBench |
|---|---|---|
| Claude Fable 5.1 | 77.8% | 10.0% |
| Claude Opus 5 | 80.6% | 12.0% |
| Claude Opus 5.5 | 77.8% | 13.0% |
| Claude Sonnet 5.5 | 77.8% | 8.0% |
| DeepSeek V4 Flash 0731 | 70.3% | 0.0% |
| GLM-5.3 | 73.0% | 0.0% |
| GLM-5.3-Flash | 78.4% | 0.0% |
| Kimi K3 | 73.2% | 1.0% |
| Muse Spark Open | 72.8% | 0.0% |
| Qwen3.8 Max | 72.5% | 0.0% |