Calibration
HLE → AA-Omniscience Accuracy
AA-Omniscience Accuracy is estimated from HLE with a Hill curve fitted on 53 models measured on both: y = 0.2083 + (1.2000 − 0.2083)·x^2.77 / (0.79711^2.77 + x^2.77), R² = 0.63, cross-validated error 9.0 pp. It is used for 4 estimates.
| Estimated model | HLE | AA-Omniscience Accuracy | Source |
|---|---|---|---|
| Hy4 | 59.1% | 50.9% | estimated ± 9.0 pp, medium confidence |
| Hy4 flash | 55.2% | 47.1% | estimated ± 9.0 pp, medium confidence |
| Agents-A1 | 47.6% | 40.0% | estimated ± 9.0 pp, medium confidence |
| Ling 3.1 Flash | 37.4% | 31.7% | estimated ± 9.0 pp, medium confidence |