benchgap
Calibration

HMMT Feb 2026 → HMMT Feb 2025

HMMT Feb 2025 is estimated from HMMT Feb 2026 with a Michaelis–Menten curve fitted on 7 models measured on both: y = 2.0000·x / (0.95975 + x), R² = 0.47, cross-validated error 1.8 pp. It is used for 14 estimates.

Estimated modelHMMT Feb 2026HMMT Feb 2025Source
DeepSeek V4 Flash 073194.8%99.4%estimated ± 1.8 pp, low confidence
DeepSeek V4 Pro 081395.2%99.6%estimated ± 1.8 pp, low confidence
Inkling-Small90.2%96.9%estimated ± 1.8 pp, low confidence
K-EXAONE 2.078.4%89.9%estimated ± 1.8 pp, low confidence
Kimi K2.692.7%98.3%estimated ± 1.8 pp, low confidence
Ling 3.0 Flash87.0%95.1%estimated ± 1.8 pp, low confidence
LongCat-Flash-Lite-Sparse40.5%59.4%estimated ± 1.8 pp, low confidence
MAI-Thinking-184.9%93.9%estimated ± 1.8 pp, low confidence
MiniCPM5-1B25.8%42.3%estimated ± 1.8 pp, low confidence
MiniCPM5-2B63.8%79.9%estimated ± 1.8 pp, low confidence
Qwen3.7 Max97.1%100.0%estimated ± 1.8 pp, low confidence
Qwen3.7 Plus92.9%98.4%estimated ± 1.8 pp, low confidence
Solar Open 293.9%98.9%estimated ± 1.8 pp, low confidence
ZAYA1-8B71.6%85.5%estimated ± 1.8 pp, low confidence