benchgap
Calibration

MMMLU → CritPt

CritPt is estimated from MMMLU with a linear curve fitted on 6 models measured on both: y = 1.8150·x + -1.5283, R² = 0.86, cross-validated error 2.9 pp. It is used for 3 estimates.

Estimated modelMMMLUCritPtSource
Interfaze Beta90.9%12.2%estimated ± 2.9 pp, low confidence
Claude 4 Opus87.4%5.8%estimated ± 2.9 pp, medium confidence
Qwen3 32B76.5%0.0%estimated ± 2.9 pp, low confidence

Fitted on

ModelMMMLUCritPt
Claude 3.7 Sonnet83.2%0.0%
Claude 3.7 Sonnet Thinking86.1%0.9%
Gemma 4 12B83.4%0.0%
K-EXAONE 2.086.6%0.9%
Qwen3.7 Max90.3%13.4%
Qwen3.7 Plus89.0%9.1%