# τ²-bench results → AA Agentic Index

Calibration · https://benchgap.net/calibration/1490 · data retrieved 2026-10-29

AA Agentic Index is estimated from τ²-bench results with a linear curve fitted on 41 models measured on both: y = 0.3462·x + -0.0821, R² = 0.40, cross-validated error 12.3 pp. It is used for 54 estimates.

| Estimated model | τ²-bench results | AA Agentic Index | Source |
|---|---|---|---|
| [GLM-5-Turbo](https://benchgap.net/model/glm-5-turbo.md) | 98.5% | 25.9% | estimated ± 12.3 pp, low confidence |
| [Qwen 3.6 Max (preview)](https://benchgap.net/model/qwen3-6-max-preview.md) | 95.9% | 25.0% | estimated ± 12.3 pp, low confidence |
| [Grok 4.1 Fast (Reasoning)](https://benchgap.net/model/grok-4-1-fast-reasoning.md) | 93.3% | 24.1% | estimated ± 12.3 pp, low confidence |
| [Qwen3.5-4B](https://benchgap.net/model/qwen3-5-4b.md) | 92.1% | 23.7% | estimated ± 12.3 pp, low confidence |
| [MiMo-V2-Omni](https://benchgap.net/model/mimo-v2-omni.md) | 91.2% | 23.4% | estimated ± 12.3 pp, low confidence |
| [Claude Opus 4.5 Thinking](https://benchgap.net/model/claude-opus-4-5-thinking.md) | 89.5% | 22.8% | estimated ± 12.3 pp, low confidence |
| [LFM2.5-8B-A1B](https://benchgap.net/model/lfm2-5-8b-a1b.md) | 88.1% | 22.3% | estimated ± 12.3 pp, low confidence |
| [GPT-5 (medium)](https://benchgap.net/model/gpt-5-medium.md) | 86.5% | 21.7% | estimated ± 12.3 pp, low confidence |
| [GPT-5.1-Codex-Max](https://benchgap.net/model/gpt-5-1-codex-max.md) | 83.0% | 20.5% | estimated ± 12.3 pp, low confidence |
| [o3](https://benchgap.net/model/o3.md) | 80.7% | 19.7% | estimated ± 12.3 pp, low confidence |
| [LLaDA2.2-flash](https://benchgap.net/model/llada2-2-flash.md) | 80.3% | 19.6% | estimated ± 12.3 pp, low confidence |
| [Ternary Bonsai 2 27B](https://benchgap.net/model/ternary-bonsai-2-27b.md) | 80.2% | 19.6% | estimated ± 12.3 pp, low confidence |
| [GLM-4.6](https://benchgap.net/model/glm-4-6.md) | 76.9% | 18.4% | estimated ± 12.3 pp, low confidence |
| [Grok Code Fast 1](https://benchgap.net/model/grok-code-fast-1.md) | 75.7% | 18.0% | estimated ± 12.3 pp, low confidence |
| [Claude 4 Opus Thinking](https://benchgap.net/model/claude-4-opus-thinking.md) | 73.4% | 17.2% | estimated ± 12.3 pp, low confidence |
| [Claude 4.1 Opus Thinking](https://benchgap.net/model/claude-4-1-opus-thinking.md) | 71.4% | 16.5% | estimated ± 12.3 pp, low confidence |
| [Grok 4 Fast (Reasoning)](https://benchgap.net/model/grok-4-fast-reasoning.md) | 65.8% | 14.6% | estimated ± 12.3 pp, low confidence |
| [o1](https://benchgap.net/model/o1.md) | 62.6% | 13.5% | estimated ± 12.3 pp, low confidence |
| [Kimi K2](https://benchgap.net/model/kimi-k2.md) | 61.1% | 12.9% | estimated ± 12.3 pp, low confidence |
| [LLaDA2.2-mini](https://benchgap.net/model/llada2-2-mini.md) | 57.5% | 11.7% | estimated ± 12.3 pp, low confidence |
| [o4-mini](https://benchgap.net/model/o4-mini.md) | 55.6% | 11.0% | estimated ± 12.3 pp, low confidence |
| [Nemotron 3.5 Bolt E4B BF16](https://benchgap.net/model/nemotron-3-5-bolt-e4b-bf16.md) | 55.1% | 10.9% | estimated ± 12.3 pp, low confidence |
| [Claude 3.7 Sonnet Thinking](https://benchgap.net/model/claude-3-7-sonnet-thinking.md) | 54.7% | 10.7% | estimated ± 12.3 pp, low confidence |
| [Nemotron 3.5 Bolt E4B](https://benchgap.net/model/nemotron-3-5-bolt-e4b.md) | 52.3% | 9.9% | estimated ± 12.3 pp, low confidence |
| [Claude 3.7 Sonnet](https://benchgap.net/model/claude-3-7-sonnet.md) | 50.0% | 9.1% | estimated ± 12.3 pp, low confidence |
| [GLM-4.5-Air](https://benchgap.net/model/glm-4-5-air.md) | 46.5% | 7.9% | estimated ± 12.3 pp, low confidence |
| [DeepSeek V3.1 (Reasoning)](https://benchgap.net/model/deepseek-v3-1-reasoning.md) | 37.4% | 4.7% | estimated ± 12.3 pp, low confidence |
| [DeepSeek-R1](https://benchgap.net/model/deepseek-r1.md) | 36.5% | 4.4% | estimated ± 12.3 pp, low confidence |
| [DeepSeek V3.1](https://benchgap.net/model/deepseek-v3-1.md) | 34.8% | 3.8% | estimated ± 12.3 pp, low confidence |
| [Solar Pro 2](https://benchgap.net/model/solar-pro-2.md) | 31.9% | 2.8% | estimated ± 12.3 pp, low confidence |
| [Mistral Large 2](https://benchgap.net/model/mistral-large-2.md) | 30.7% | 2.4% | estimated ± 12.3 pp, low confidence |
| [Gemini 2.0 Flash](https://benchgap.net/model/gemini-2-0-flash.md) | 29.5% | 2.0% | estimated ± 12.3 pp, low confidence |
| [o3-mini](https://benchgap.net/model/o3-mini.md) | 28.7% | 1.7% | estimated ± 12.3 pp, low confidence |
| [Devstral Small](https://benchgap.net/model/devstral-small.md) | 28.4% | 1.6% | estimated ± 12.3 pp, low confidence |
| [Magistral Small](https://benchgap.net/model/magistral-small.md) | 26.6% | 1.0% | estimated ± 12.3 pp, low confidence |
| [Mistral Medium 3](https://benchgap.net/model/mistral-medium-3.md) | 24.3% | 0.2% | estimated ± 12.3 pp, low confidence |
| [Claude 3 Haiku](https://benchgap.net/model/claude-3-haiku.md) | 21.1% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Exaone 4.0 1.2B](https://benchgap.net/model/exaone-4-0-1-2b.md) | 20.5% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Exaone 4.0 32B](https://benchgap.net/model/exaone-4-0-32b.md) | 4.1% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Gemini 2.5 Flash](https://benchgap.net/model/gemini-2-5-flash.md) | 14.9% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Gemini 2.5 Flash-Lite](https://benchgap.net/model/gemini-2-5-flash-lite.md) | 19.0% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Granite-4.0-350M](https://benchgap.net/model/granite-4-0-350m.md) | 13.2% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Granite-4.0-H-1B](https://benchgap.net/model/granite-4-0-h-1b.md) | 19.6% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Granite-4.0-H-350M](https://benchgap.net/model/granite-4-0-h-350m.md) | 14.6% | 0.0% | estimated ± 12.3 pp, low confidence |
| [LFM2.5-VL-1.6B-Extract](https://benchgap.net/model/lfm2-5-vl-1-6b-extract.md) | 8.5% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Llama 3.1 405B](https://benchgap.net/model/llama-3-1-405b.md) | 19.0% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Llama 3.1 70B](https://benchgap.net/model/llama-3-1-70b.md) | 21.6% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Magistral Medium](https://benchgap.net/model/magistral-medium.md) | 23.1% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Nemotron Ultra 253B](https://benchgap.net/model/nemotron-ultra-253b.md) | 11.4% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Nova Pro](https://benchgap.net/model/nova-pro.md) | 14.0% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Phi-4](https://benchgap.net/model/phi-4.md) | 0.0% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Phi-4-reasoning](https://benchgap.net/model/phi-4-reasoning.md) | 0.0% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Qwen3-Omni-30B-A3B-Instruct](https://benchgap.net/model/qwen3-omni-30b-a3b-instruct.md) | 16.4% | 0.0% | estimated ± 12.3 pp, low confidence |
| [Qwen3-Omni-30B-A3B-Thinking](https://benchgap.net/model/qwen3-omni-30b-a3b-thinking.md) | 21.3% | 0.0% | estimated ± 12.3 pp, low confidence |

## Fitted on

| Model | τ²-bench results | AA Agentic Index |
|---|---|---|
| [Claude Fable 5](https://benchgap.net/model/claude-fable.md) | 98.5% | 51.0% |
| [Claude Opus 4.7 (Adaptive)](https://benchgap.net/model/claude-opus-4-7-adaptive.md) | 88.6% | 39.5% |
| [Claude Opus 4.8](https://benchgap.net/model/claude-opus-4-8.md) | 94.4% | 42.6% |
| [Command A+](https://benchgap.net/model/command-a-plus.md) | 85.0% | 3.6% |
| [DeepSeek V3](https://benchgap.net/model/deepseek-v3.md) | 22.8% | 0.8% |
| [DeepSeek V4 Pro 0813](https://benchgap.net/model/deepseek-v4-pro-0813.md) | 96.2% | 49.6% |
| [Gemini 2.5 Pro](https://benchgap.net/model/gemini-2-5-pro.md) | 54.1% | 3.6% |
| [Gemini 3.1 Pro](https://benchgap.net/model/gemini-3-1-pro.md) | 95.6% | 10.3% |
| [Gemini 3.5 Flash](https://benchgap.net/model/gemini-3-5-flash.md) | 95.3% | 27.3% |
| [Gemma 3 27B](https://benchgap.net/model/gemma-3-27b.md) | 10.5% | 0.1% |
| [Gemma 4 31B](https://benchgap.net/model/gemma-4-31b.md) | 59.9% | 6.7% |
| [GLM-5.1](https://benchgap.net/model/glm-5-1.md) | 97.7% | 25.2% |
| [GLM-5.2](https://benchgap.net/model/glm-5-2.md) | 99.1% | 39.4% |
| [GPT-5.4 mini](https://benchgap.net/model/gpt-5-4-mini.md) | 93.4% | 19.7% |
| [GPT-5.4 nano](https://benchgap.net/model/gpt-5-4-nano.md) | 92.5% | 17.7% |
| [GPT-5.5](https://benchgap.net/model/gpt-5-5.md) | 98.0% | 37.3% |
| [GPT-5.6 Sol](https://benchgap.net/model/gpt-5-6-sol.md) | 85.1% | 50.5% |
| [GPT-5.6 Terra](https://benchgap.net/model/gpt-5-6-terra.md) | 86.3% | 43.7% |
| [GPT-OSS 120B](https://benchgap.net/model/gpt-oss-120b.md) | 65.8% | 6.2% |
| [GPT-OSS 20B](https://benchgap.net/model/gpt-oss-20b.md) | 60.2% | 1.4% |
| [Grok 4.3](https://benchgap.net/model/grok-4-3.md) | 97.7% | 17.2% |
| [Kimi K2.6](https://benchgap.net/model/kimi-2-6.md) | 95.9% | 22.1% |
| [Kimi K2.7 Code](https://benchgap.net/model/kimi-k2-7-code.md) | 90.1% | 22.5% |
| [Llama 4 Maverick](https://benchgap.net/model/llama-4-maverick.md) | 17.8% | 0.6% |
| [Llama 4 Scout](https://benchgap.net/model/llama-4-scout.md) | 15.5% | 0.5% |
| [MiMo-V2.5-Pro](https://benchgap.net/model/mimo-v2-5-pro.md) | 94.2% | 22.7% |
| [MiniMax M2.7](https://benchgap.net/model/minimax-m2-7.md) | 84.8% | 16.8% |
| [MiniMax M3](https://benchgap.net/model/minimax-m3.md) | 88.9% | 30.8% |
| [Mistral Large 3](https://benchgap.net/model/mistral-large-3.md) | 24.6% | 2.4% |
| [Mistral Medium 3.5 128B](https://benchgap.net/model/mistral-medium-3-5-128b.md) | 94.2% | 9.4% |
| [Mistral Small 4](https://benchgap.net/model/mistral-small-4.md) | 41.2% | 1.4% |
| [Mistral Small 4 (Reasoning)](https://benchgap.net/model/mistral-small-4-reasoning.md) | 18.4% | 1.4% |
| [Nemotron 3 Nano 30B](https://benchgap.net/model/nemotron-3-nano-30b.md) | 25.4% | 1.0% |
| [Nemotron 3 Ultra](https://benchgap.net/model/nemotron-3-ultra.md) | 83.3% | 21.7% |
| [Qwen3.5-122B-A10B](https://benchgap.net/model/qwen3-5-122b-a10b.md) | 93.6% | 9.6% |
| [Qwen3.6-27B](https://benchgap.net/model/qwen3-6-27b.md) | 94.2% | 20.1% |
| [Qwen3.6-35B-A3B](https://benchgap.net/model/qwen3-6-35b-a3b.md) | 95.3% | 15.0% |
| [Qwen3.7 Max](https://benchgap.net/model/qwen3-7-max.md) | 94.7% | 23.9% |
| [Qwen3.7 Plus](https://benchgap.net/model/qwen3-7-plus.md) | 93.0% | 19.7% |
| [Trinity-Large-Preview](https://benchgap.net/model/trinity-large-preview.md) | 90.1% | 1.2% |
| [Trinity-Large-Thinking](https://benchgap.net/model/trinity-large-thinking.md) | 90.1% | 1.2% |