Calibration
PostTrainBench v1.1 → Vals SWE-bench
Vals SWE-bench is estimated from PostTrainBench v1.1 with a Hill curve fitted on 9 models measured on both: y = 0.7919 + (1.2000 − 0.7919)·x^6.00 / (0.38664^6.00 + x^6.00), R² = 0.69, cross-validated error 4.5 pp. It is used for 2 estimates.
| Estimated model | PostTrainBench v1.1 | Vals SWE-bench | Source |
|---|---|---|---|
| Claude Fable 5.1 | 40.2% | 100.0% | estimated ± 4.5 pp, medium confidence |
| Gemini 4 Argon | 45.3% | 100.0% | estimated ± 4.5 pp, medium confidence |