Calibration
HLE w/o tools → AA-Omniscience Accuracy
AA-Omniscience Accuracy is estimated from HLE w/o tools with a linear curve fitted on 27 models measured on both: y = 0.9467·x + 0.0388, R² = 0.75, cross-validated error 8.6 pp. It is used for 3 estimates.
| Estimated model | HLE w/o tools | AA-Omniscience Accuracy | Source |
|---|---|---|---|
| Pareto 26.9 | 49.0% | 50.3% | estimated ± 8.6 pp, medium confidence |
| Beam | 36.2% | 38.2% | estimated ± 8.6 pp, medium confidence |
| Solar Open 2 | 28.8% | 31.1% | estimated ± 8.6 pp, medium confidence |