Calibration
SWE-bench Pro → FrontierCode 1.1 Main
FrontierCode 1.1 Main is estimated from SWE-bench Pro with a Michaelis–Menten curve fitted on 8 models measured on both: y = 2.0000·x / (2.39264 + x), R² = 0.73, cross-validated error 5.5 pp. It is used for 3 estimates.
| Estimated model | SWE-bench Pro | FrontierCode 1.1 Main | Source |
|---|---|---|---|
| Atria Dawn Preview | 59.6% | 39.9% | estimated ± 5.5 pp, medium confidence |
| Sakana Fugu | 59.0% | 39.6% | estimated ± 5.5 pp, medium confidence |
| Sakana Fugu-Ultra | 73.7% | 47.1% | estimated ± 5.5 pp, medium confidence |