Calibration

HLE → AA-Omniscience Accuracy

Name: benchgap: LLM benchmark scores, measured and estimated
Creator: benchgap

AA-Omniscience Accuracy is estimated from HLE with a linear curve fitted on 48 models measured on both: y = 0.6931·x + 0.0688, R² = 0.51, cross-validated error 10.5 pp. It is used for 1 estimate.

Estimated model	HLE	AA-Omniscience Accuracy	Source
Agents-A1	47.6%	39.9%	estimated ± 10.5 pp, low confidence