benchgap
Calibration

RealWorldQA → MMMU-Pro

MMMU-Pro is estimated from RealWorldQA with a Hill curve fitted on 11 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.77336^6.00 + x^6.00), R² = 0.61, cross-validated error 11.3 pp. It is used for 1 estimate.

Estimated modelRealWorldQAMMMU-ProSource
North Micro Vision Instruct62.2%25.6%estimated ± 11.3 pp, low confidence

Fitted on

ModelRealWorldQAMMMU-Pro
Claude Opus 4.577.0%70.6%
Gemini 3 Pro83.3%81.0%
GPT-5.283.3%79.5%
Kimi K2.581.0%78.5%
LFM2.5-VL-3B73.1%30.5%
LFM3-VL-2B79.3%45.7%
Qwen3.5 397B83.9%79.0%
Qwen3.6-27B84.1%75.8%
Qwen3.6-35B-A3B85.3%75.3%
Qwen3.7 Plus86.9%79.0%
Qwen3.8 Max88.0%82.3%