benchgap
Calibration

HMMT Feb 2025 → HMMT Nov 2025

HMMT Nov 2025 is estimated from HMMT Feb 2025 with a linear curve fitted on 7 models measured on both: y = 0.9151·x + 0.0611, R² = 0.66, cross-validated error 1.9 pp. It is used for 3 estimates.

Estimated modelHMMT Feb 2025HMMT Nov 2025Source
Granite 4.2 30B89.2%87.7%estimated ± 1.9 pp, low confidence
Granite 4.2 3B66.7%67.1%estimated ± 1.9 pp, low confidence
Granite 4.2 8B78.3%77.8%estimated ± 1.9 pp, low confidence