benchgap
Calibration

BBH → MMLU

MMLU is estimated from BBH with a linear curve fitted on 6 models measured on both: y = 0.8595·x + 0.0762, R² = 0.99, cross-validated error 2.2 pp. It is used for 0 estimates.

Fitted on

ModelBBHMMLU
Claude 3.5 Haiku86.6%80.3%
Granite-4.0-1B60.4%59.4%
Granite-4.0-350M33.1%35.0%
Granite-4.0-H-1B59.7%59.7%
Granite-4.0-H-350M33.3%36.2%
Phi-3.5-mini69.0%69.0%