# AutomationBench → CWE-bench

Calibration · https://benchgap.net/calibration/automationbench/current/to/cwe-bench-v2/current · data retrieved 2026-11-20

CWE-bench is estimated from AutomationBench with a Hill curve fitted on 9 models measured on both: y = 0.2910 + (0.6325 − 0.2910)·x^6.00 / (0.28410^6.00 + x^6.00), R² = 0.32, cross-validated error 11.0 pp. It is used for 10 estimates.

| Estimated model | AutomationBench | CWE-bench | Source |
|---|---|---|---|
| [ERNIE 5.5 Flash Preview](https://benchgap.net/model/ernie-5-5-flash-preview.md) | 61.9% | 62.9% | estimated ± 11.0 pp, low confidence |
| [Atria Dawn Preview](https://benchgap.net/model/atria-dawn-preview.md) | 53.8% | 62.5% | estimated ± 11.0 pp, low confidence |
| [Ling 3.1 Flash](https://benchgap.net/model/ling-3-1-flash.md) | 52.5% | 62.4% | estimated ± 11.0 pp, low confidence |
| [Hy4 flash](https://benchgap.net/model/hy4-flash.md) | 52.2% | 62.4% | estimated ± 11.0 pp, low confidence |
| [LongCat-2.5](https://benchgap.net/model/longcat-2-5.md) | 51.8% | 62.3% | estimated ± 11.0 pp, low confidence |
| [Ultramarine 1 Flash](https://benchgap.net/model/ultramarine-1-flash.md) | 50.2% | 62.2% | estimated ± 11.0 pp, low confidence |
| [LFM3-1.7B](https://benchgap.net/model/lfm3-1-7b.md) | 41.3% | 60.0% | estimated ± 11.0 pp, low confidence |
| [Ripple-65B Preview](https://benchgap.net/model/ripple-65b-preview.md) | 36.4% | 56.9% | estimated ± 11.0 pp, low confidence |
| [DeepSeek V4 Pro](https://benchgap.net/model/deepseek-v4-pro.md) | 31.8% | 51.7% | estimated ± 11.0 pp, low confidence |
| [LFM2.5-24B-A2B](https://benchgap.net/model/lfm2-5-24b-a2b.md) | 27.7% | 44.9% | estimated ± 11.0 pp, low confidence |

## Fitted on

| Model | AutomationBench | CWE-bench |
|---|---|---|
| [Claude Fable 5.2](https://benchgap.net/model/claude-fable-5-2.md) | 51.4% | 75.0% |
| [Claude Opus 5.5](https://benchgap.net/model/claude-opus-5-5.md) | 40.0% | 67.1% |
| [DeepSeek V4.1 Flash 1017](https://benchgap.net/model/deepseek-v4-1-flash.md) | 60.5% | 57.6% |
| [Gemini 4 Argon](https://benchgap.net/model/gemini-4-argon.md) | 51.3% | 65.0% |
| [GLM-5.3](https://benchgap.net/model/glm-5-3.md) | 48.2% | 42.0% |
| [GPT-6 Astra](https://benchgap.net/model/gpt-6-astra.md) | 41.4% | 64.2% |
| [Hy4](https://benchgap.net/model/hy4.md) | 56.2% | 64.1% |
| [Hy4 preview](https://benchgap.net/model/hy4-preview.md) | 32.1% | 47.3% |
| [Qwen3.8 Max](https://benchgap.net/model/qwen3-8-max.md) | 27.3% | 45.4% |
