Calibration

SWE-bench Pro → AA Coding Index

Name: benchgap: LLM benchmark scores, measured and estimated
Creator: benchgap

AA Coding Index is estimated from SWE-bench Pro with a Hill curve fitted on 38 models measured on both: y = 0.2114 + (0.8676 − 0.2114)·x^6.00 / (0.53173^6.00 + x^6.00), R² = 0.72, cross-validated error 7.5 pp. It is used for 1 estimate.

Estimated model	SWE-bench Pro	AA Coding Index	Source
Atria Dawn Preview	59.6%	64.8%	estimated ± 7.5 pp, medium confidence