Calibration
FrontierCode 1.1 Main → AA Coding Index
AA Coding Index is estimated from FrontierCode 1.1 Main with a Hill curve fitted on 8 models measured on both: y = 0.0003 + (0.8020 − 0.0003)·x^3.47 / (0.21167^3.47 + x^3.47), R² = 0.97, cross-validated error 3.3 pp. It is used for 4 estimates.
| Estimated model | FrontierCode 1.1 Main | AA Coding Index | Source |
|---|---|---|---|
| Claude Haiku 5.5 | 46.4% | 75.2% | estimated ± 3.3 pp, high confidence |
| Claude Opus 4.6 | 26.9% | 55.9% | estimated ± 3.3 pp, medium confidence |
| Claude Sonnet 4.6 | 24.3% | 49.5% | estimated ± 3.3 pp, medium confidence |
| SWE-1.7 | 42.3% | 73.5% | estimated ± 3.3 pp, high confidence |