# AA AutomationBench → CWE-Bench-AA

Calibration · https://benchgap.net/calibration/aa-automation-bench/current/to/aa-cwe-bench/current · data retrieved 2026-11-18

CWE-Bench-AA is estimated from AA AutomationBench with a Hill curve fitted on 11 models measured on both: y = 0.0000 + (0.6745 − 0.0000)·x^6.00 / (0.44399^6.00 + x^6.00), R² = 0.63, cross-validated error 9.0 pp. It is used for 3 estimates.

| Estimated model | AA AutomationBench | CWE-Bench-AA | Source |
|---|---|---|---|
| [Qwen4 Max](https://benchgap.net/model/qwen4-max.md) | 72.6% | 64.1% | estimated ± 9.0 pp, medium confidence |
| [Muse Ember](https://benchgap.net/model/muse-ember.md) | 68.1% | 62.6% | estimated ± 9.0 pp, medium confidence |
| [Muse Wonder Full](https://benchgap.net/model/muse-wonder-full.md) | 45.4% | 36.0% | estimated ± 9.0 pp, low confidence |

## Fitted on

| Model | AA AutomationBench | CWE-Bench-AA |
|---|---|---|
| [Claude Opus 5.5](https://benchgap.net/model/claude-opus-5-5.md) | 69.5% | 58.3% |
| [GLM-5.3](https://benchgap.net/model/glm-5-3.md) | 62.2% | 55.8% |
| [GPT-6.2 Astra](https://benchgap.net/model/gpt-6-2-astra.md) | 77.2% | 65.0% |
| [GPT-6.2 Sol](https://benchgap.net/model/gpt-6-2-sol.md) | 71.3% | 61.7% |
| [GPT-6 Luna](https://benchgap.net/model/gpt-6-luna.md) | 53.2% | 56.7% |
| [Grok 4.7](https://benchgap.net/model/grok-4-7.md) | 65.6% | 68.3% |
| [Kimi K3.1 Pro](https://benchgap.net/model/kimi-3-1-pro.md) | 73.3% | 60.8% |
| [MiMo-V2.6-Pro](https://benchgap.net/model/mimo-v2-6-pro.md) | 58.6% | 63.3% |
| [Mistral Large 4](https://benchgap.net/model/mistral-large-4.md) | 57.8% | 58.3% |
| [Qwen3.8-27B](https://benchgap.net/model/qwen3-8-27b.md) | 48.2% | 26.7% |
| [Beam 1.0 501B-A23B](https://benchgap.net/model/reflection-beam.md) | 48.5% | 49.2% |
