benchgap
Calibration

AA AutomationBench → JobBench

JobBench is estimated from AA AutomationBench with a offset logistic curve fitted on 5 models measured on both: y = 0.0071 + (0.5993 − 0.0071) / (1 + exp(−140.22·(x − 0.4805))), R² = 0.88, cross-validated error 9.1 pp. It is used for 1 estimate.

Estimated modelAA AutomationBenchJobBenchSource
Claude Haiku 5.535.4%0.7%estimated ± 9.1 pp, low confidence