benchgap
Calibration

Toolathlon-Verified → AA Agentic Index

AA Agentic Index is estimated from Toolathlon-Verified with a linear curve fitted on 7 models measured on both: y = 1.3035·x + -0.4596, R² = 0.93, cross-validated error 3.3 pp. It is used for 8 estimates.

Estimated modelToolathlon-VerifiedAA Agentic IndexSource
dots3-note Preview55.6%26.5%estimated ± 3.3 pp, medium confidence
GLM-5.3-Flash78.4%56.2%estimated ± 3.3 pp, medium confidence
Hy4 preview74.1%50.6%estimated ± 3.3 pp, medium confidence
Laguna S 2.149.7%18.8%estimated ± 3.3 pp, low confidence
Ornith-1.5-35B-A3B48.7%17.5%estimated ± 3.3 pp, low confidence
Ornith-1.5-397B71.2%46.8%estimated ± 3.3 pp, medium confidence
Ornith-1.5-9B41.2%7.7%estimated ± 3.3 pp, low confidence
Qwen3.8 Max72.5%48.5%estimated ± 3.3 pp, medium confidence