Calibration
Toolathlon → AA Agentic Index
AA Agentic Index is estimated from Toolathlon with a offset logistic curve fitted on 15 models measured on both: y = 0.1655 + (0.3883 − 0.1655) / (1 + exp(−198.58·(x − 0.4691))), R² = 0.58, cross-validated error 10.4 pp. It is used for 0 estimates.
Fitted on
| Model | Toolathlon | AA Agentic Index |
|---|---|---|
| Claude Opus 4.8 | 59.9% | 42.6% |
| DeepSeek V4 Flash 0731 | 47.8% | 41.7% |
| DeepSeek V4 Pro 0813 | 51.8% | 49.6% |
| Gemini 3.5 Flash | 56.5% | 27.3% |
| GLM-5.2 | 48.2% | 39.4% |
| GPT-5.4 mini | 42.9% | 19.7% |
| GPT-5.4 nano | 35.5% | 17.7% |
| GPT-5.5 | 55.6% | 37.3% |
| GPT-5.6 Luna | 53.4% | 42.7% |
| GPT-5.6 Sol | 58.0% | 50.5% |
| GPT-5.6 Terra | 53.1% | 43.7% |
| Kimi K2.6 | 50.0% | 22.1% |
| MiniMax M2.7 | 46.3% | 16.8% |
| Muse Spark 1.1 | 75.6% | 27.5% |
| Qwen3.6-35B-A3B | 26.9% | 15.0% |