# Toolathlon-Verified → AA AutomationBench

Calibration · https://benchgap.net/calibration/1528 · data retrieved 2026-10-29

AA AutomationBench is estimated from Toolathlon-Verified with a Hill curve fitted on 7 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.75584^6.00 + x^6.00), R² = 0.46, cross-validated error 7.3 pp. It is used for 4 estimates.

| Estimated model | Toolathlon-Verified | AA AutomationBench | Source |
|---|---|---|---|
| [DeepSeek V4 Pro 0813](https://benchgap.net/model/deepseek-v4-pro-0813.md) | 74.1% | 56.4% | estimated ± 7.3 pp, low confidence |
| [Hy4 preview](https://benchgap.net/model/hy4-preview.md) | 74.1% | 56.4% | estimated ± 7.3 pp, low confidence |
| [Ornith-1.5-397B](https://benchgap.net/model/ornith-1-5-397b.md) | 71.2% | 49.4% | estimated ± 7.3 pp, low confidence |
| [DeepSeek V4 Flash 0731](https://benchgap.net/model/deepseek-v4-flash-0731.md) | 70.3% | 47.2% | estimated ± 7.3 pp, low confidence |

## Fitted on

| Model | Toolathlon-Verified | AA AutomationBench |
|---|---|---|
| [Claude Fable 5.1](https://benchgap.net/model/claude-fable-5-1.md) | 77.8% | 59.4% |
| [Claude Opus 5.5](https://benchgap.net/model/claude-opus-5-5.md) | 77.8% | 69.5% |
| [Claude Sonnet 5.5](https://benchgap.net/model/claude-sonnet-5-5.md) | 77.8% | 71.8% |
| [GLM-5.3](https://benchgap.net/model/glm-5-3.md) | 73.0% | 62.2% |
| [MiMo-V2.6-Pro](https://benchgap.net/model/mimo-v2-6-pro.md) | 76.9% | 58.6% |
| [Muse Spark Open](https://benchgap.net/model/muse-spark-open.md) | 72.8% | 49.7% |
| [Step 5 Preview](https://benchgap.net/model/step-5-preview.md) | 74.1% | 51.0% |