Calibration
AA-SciCode → FrontierCode 1.1 Main
FrontierCode 1.1 Main is estimated from AA-SciCode with a offset logistic curve fitted on 11 models measured on both: y = 0.0000 + (0.5079 − 0.0000) / (1 + exp(−75.55·(x − 0.5191))), R² = 0.76, cross-validated error 6.6 pp. It is used for 9 estimates.
| Estimated model | AA-SciCode | FrontierCode 1.1 Main | Source |
|---|---|---|---|
| A.X K2 | 41.0% | 0.0% | estimated ± 6.6 pp, low confidence |
| DeepSeek V3 0324 | 39.0% | 0.0% | estimated ± 6.6 pp, low confidence |
| Granite 4.2 3B | 25.3% | 0.0% | estimated ± 6.6 pp, low confidence |
| Ling 3.0 Flash VL | 44.2% | 0.1% | estimated ± 6.6 pp, low confidence |
| Ling 3.0 Tiny | 24.2% | 0.0% | estimated ± 6.6 pp, low confidence |
| Ling 3.1 Flash | 54.1% | 42.7% | estimated ± 6.6 pp, medium confidence |
| Mercury 2.5 | 38.5% | 0.0% | estimated ± 6.6 pp, low confidence |
| North Mini Code | 38.8% | 0.0% | estimated ± 6.6 pp, low confidence |
| Solar Pro 3 | 25.5% | 0.0% | estimated ± 6.6 pp, low confidence |