Calibration
Toolathlon-Verified → AA Agentic Index
AA Agentic Index is estimated from Toolathlon-Verified with a linear curve fitted on 7 models measured on both: y = 1.3035·x + -0.4596, R² = 0.93, cross-validated error 3.3 pp. It is used for 8 estimates.
| Estimated model | Toolathlon-Verified | AA Agentic Index | Source |
|---|---|---|---|
| GLM-5.3-Flash | 78.4% | 56.2% | estimated ± 3.3 pp, medium confidence |
| Hy4 preview | 74.1% | 50.6% | estimated ± 3.3 pp, medium confidence |
| Qwen3.8 Max | 72.5% | 48.5% | estimated ± 3.3 pp, medium confidence |
| Ornith-1.5-397B | 71.2% | 46.8% | estimated ± 3.3 pp, medium confidence |
| dots3-note Preview | 55.6% | 26.5% | estimated ± 3.3 pp, medium confidence |
| Laguna S 2.1 | 49.7% | 18.8% | estimated ± 3.3 pp, low confidence |
| Ornith-1.5-35B-A3B | 48.7% | 17.5% | estimated ± 3.3 pp, low confidence |
| Ornith-1.5-9B | 41.2% | 7.7% | estimated ± 3.3 pp, low confidence |
Fitted on
| Model | Toolathlon-Verified | AA Agentic Index |
|---|---|---|
| Claude Fable 5.1 | 77.8% | 58.0% |
| Claude Opus 5 | 80.6% | 56.2% |
| DeepSeek V4 Flash 0731 | 70.3% | 41.7% |
| DeepSeek V4 Pro 0813 | 74.1% | 49.6% |
| GLM-5.3 | 73.0% | 53.4% |
| Inkling-Small | 54.4% | 25.0% |
| Kimi K3 | 73.2% | 50.6% |