Calibration
Hermes Bench → CWE-Bench-AA
CWE-Bench-AA is estimated from Hermes Bench with a Michaelis–Menten curve fitted on 10 models measured on both: y = 2.0000·x / (1.73862 + x), R² = 0.36, cross-validated error 4.6 pp. It is used for 2 estimates.
| Estimated model | Hermes Bench | CWE-Bench-AA | Source |
|---|---|---|---|
| Hy4 preview | 70.8% | 57.9% | estimated ± 4.6 pp, medium confidence |
| Ling 3.0 Flash | 53.8% | 47.3% | estimated ± 4.6 pp, low confidence |
Fitted on
| Model | Hermes Bench | CWE-Bench-AA |
|---|---|---|
| Claude Opus 5.5 | 76.7% | 58.3% |
| Gemini 3.8 Flash | 62.2% | 52.5% |
| GLM-5.3 | 71.8% | 55.8% |
| GLM-5.3-Flash | 68.9% | 55.8% |
| GPT-6 Astra | 73.7% | 63.3% |
| GPT-6 Luna | 70.5% | 56.7% |
| GPT-6 Sol | 73.5% | 64.2% |
| Grok 4.7 | 74.4% | 68.3% |
| Kimi K3 | 71.5% | 53.3% |
| Step 5 Preview | 69.2% | 52.5% |