Calibration
MMMLU → CritPt
CritPt is estimated from MMMLU with a linear curve fitted on 6 models measured on both: y = 1.8150·x + -1.5283, R² = 0.86, cross-validated error 2.9 pp. It is used for 3 estimates.
| Estimated model | MMMLU | CritPt | Source |
|---|---|---|---|
| Interfaze Beta | 90.9% | 12.2% | estimated ± 2.9 pp, low confidence |
| Claude 4 Opus | 87.4% | 5.8% | estimated ± 2.9 pp, medium confidence |
| Qwen3 32B | 76.5% | 0.0% | estimated ± 2.9 pp, low confidence |
Fitted on
| Model | MMMLU | CritPt |
|---|---|---|
| Claude 3.7 Sonnet | 83.2% | 0.0% |
| Claude 3.7 Sonnet Thinking | 86.1% | 0.9% |
| Gemma 4 12B | 83.4% | 0.0% |
| K-EXAONE 2.0 | 86.6% | 0.9% |
| Qwen3.7 Max | 90.3% | 13.4% |
| Qwen3.7 Plus | 89.0% | 9.1% |