Calibration
Toolathlon-Verified → AA-AnalystAgent
AA-AnalystAgent is estimated from Toolathlon-Verified with a Hill curve fitted on 7 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.82172^6.00 + x^6.00), R² = 0.52, cross-validated error 7.8 pp. It is used for 5 estimates.
| Estimated model | Toolathlon-Verified | AA-AnalystAgent | Source |
|---|---|---|---|
| DeepSeek V4 Pro 0813 | 74.1% | 42.0% | estimated ± 7.8 pp, low confidence |
| Qwen3.8-Flash-Next | 73.5% | 40.6% | estimated ± 7.8 pp, low confidence |
| Muse Spark Open | 72.8% | 39.1% | estimated ± 7.8 pp, low confidence |
| Ornith-1.5-397B | 71.2% | 35.7% | estimated ± 7.8 pp, low confidence |
| DeepSeek V4 Flash 0731 | 70.3% | 33.8% | estimated ± 7.8 pp, low confidence |
Fitted on
| Model | Toolathlon-Verified | AA-AnalystAgent |
|---|---|---|
| Claude Fable 5.1 | 77.8% | 57.5% |
| Claude Opus 5 | 80.6% | 53.8% |
| Claude Opus 5.5 | 77.8% | 56.3% |
| Claude Sonnet 5.5 | 77.8% | 57.5% |
| GLM-5.3 | 73.0% | 38.8% |
| MiMo-V2.6-Pro | 76.9% | 37.5% |
| Step 5 Preview | 74.1% | 35.0% |