Calibration
Toolathlon-Verified → JobBench
JobBench is estimated from Toolathlon-Verified with a Hill curve fitted on 7 models measured on both: y = 0.0000 + (1.0000 − 0.0000)·x^6.00 / (0.70094^6.00 + x^6.00), R² = 0.49, cross-validated error 3.4 pp. It is used for 14 estimates.
| Estimated model | Toolathlon-Verified | JobBench | Source |
|---|---|---|---|
| Claude Fable 5.1 | 77.8% | 65.2% | estimated ± 3.4 pp, low confidence |
| Claude Opus 5 | 80.6% | 69.8% | estimated ± 3.4 pp, low confidence |
| Claude Opus 5.5 | 77.8% | 65.2% | estimated ± 3.4 pp, low confidence |
| Claude Sonnet 5.5 | 77.8% | 65.2% | estimated ± 3.4 pp, low confidence |
| DeepSeek V4 Flash 0731 | 70.3% | 50.4% | estimated ± 3.4 pp, low confidence |
| DeepSeek V4 Pro 0813 | 74.1% | 58.3% | estimated ± 3.4 pp, low confidence |
| dots3-note Preview | 55.6% | 19.9% | estimated ± 3.4 pp, low confidence |
| GLM-5.3 | 73.0% | 56.1% | estimated ± 3.4 pp, low confidence |
| GLM-5.3-Flash | 78.4% | 66.2% | estimated ± 3.4 pp, low confidence |
| Inkling-Small | 54.4% | 17.9% | estimated ± 3.4 pp, low confidence |
| Laguna S 2.1 | 49.7% | 11.3% | estimated ± 3.4 pp, low confidence |
| Ornith-1.5-35B-A3B | 48.7% | 10.1% | estimated ± 3.4 pp, low confidence |
| Ornith-1.5-397B | 71.2% | 52.3% | estimated ± 3.4 pp, low confidence |
| Ornith-1.5-9B | 41.2% | 4.0% | estimated ± 3.4 pp, low confidence |