Calibration
ExploitGym → AA AutomationBench
AA AutomationBench is estimated from ExploitGym with a linear curve fitted on 7 models measured on both: y = 0.2810·x + 0.5616, R² = 0.34, cross-validated error 5.5 pp. It is used for 4 estimates.
| Estimated model | ExploitGym | AA AutomationBench | Source |
|---|---|---|---|
| Claude Mythos Preview | 17.5% | 61.1% | estimated ± 5.5 pp, low confidence |
| GPT-5.6 Luna | 12.4% | 59.6% | estimated ± 5.5 pp, low confidence |
| GPT-5.6 Sol | 33.7% | 65.6% | estimated ± 5.5 pp, low confidence |
| GPT-5.6 Terra | 23.2% | 62.7% | estimated ± 5.5 pp, low confidence |