Calibration
Toolathlon-Verified → GDPval-AA
GDPval-AA is estimated from Toolathlon-Verified with a inverse Michaelis–Menten curve fitted on 14 models measured on both: y = 0.43292·(x − 0.0000) / (0.0000 + 1.3230 − x), R² = 0.82, cross-validated error 5.6 pp. It is used for 7 estimates.
| Estimated model | Toolathlon-Verified | GDPval-AA | Source |
|---|---|---|---|
| GLM-5.3-Flash | 78.4% | 63.0% | estimated ± 5.6 pp, medium confidence |
| Qwen3.8 Max | 72.5% | 52.5% | estimated ± 5.6 pp, medium confidence |
| Ornith-1.5-397B | 71.2% | 50.5% | estimated ± 5.6 pp, medium confidence |
| dots3-note Preview | 55.6% | 31.4% | estimated ± 5.6 pp, medium confidence |
| Laguna S 2.1 | 49.7% | 26.1% | estimated ± 5.6 pp, low confidence |
| Ornith-1.5-35B-A3B | 48.7% | 25.2% | estimated ± 5.6 pp, low confidence |
| Ornith-1.5-9B | 41.2% | 19.6% | estimated ± 5.6 pp, low confidence |
Fitted on
| Model | Toolathlon-Verified | GDPval-AA |
|---|---|---|
| Claude Fable 5.1 | 77.8% | 62.7% |
| Claude Opus 5 | 80.6% | 61.1% |
| Claude Opus 5.5 | 77.8% | 68.3% |
| Claude Sonnet 5.5 | 77.8% | 66.9% |
| DeepSeek V4 Flash 0731 | 70.3% | 46.7% |
| DeepSeek V4 Pro 0813 | 74.1% | 54.5% |
| GLM-5.3 | 73.0% | 57.5% |
| Inkling-Small | 54.4% | 31.2% |
| Kimi K3 | 73.2% | 51.6% |
| MiMo-V2.6-Flash | 73.6% | 55.4% |
| MiMo-V2.6-Pro | 76.9% | 59.2% |
| Muse Spark Open | 72.8% | 45.1% |
| Qwen3.8-Flash-Next | 73.5% | 56.4% |
| Step 5 Preview | 74.1% | 54.3% |