Calibration
BBH → MMLU
MMLU is estimated from BBH with a linear curve fitted on 6 models measured on both: y = 0.8595·x + 0.0762, R² = 0.99, cross-validated error 2.2 pp. It is used for 0 estimates.
Fitted on
| Model | BBH | MMLU |
|---|---|---|
| Claude 3.5 Haiku | 86.6% | 80.3% |
| Granite-4.0-1B | 60.4% | 59.4% |
| Granite-4.0-350M | 33.1% | 35.0% |
| Granite-4.0-H-1B | 59.7% | 59.7% |
| Granite-4.0-H-350M | 33.3% | 36.2% |
| Phi-3.5-mini | 69.0% | 69.0% |