benchgap
Calibration

Artificial Analysis Intelligence Index → CritPt

CritPt is estimated from Artificial Analysis Intelligence Index with a Hill curve fitted on 186 models measured on both: y = 0.0000 + (0.4417 − 0.0000)·x^3.51 / (0.46132^3.51 + x^3.51), R² = 0.87, cross-validated error 3.7 pp. It is used for 2 estimates.

Estimated modelArtificial Analysis Intelligence IndexCritPtSource
Claude 4.1 Opus18.6%1.7%estimated ± 3.7 pp, high confidence
o1-pro12.4%0.4%estimated ± 3.7 pp, high confidence