benchgap
Calibration

Video-MME (w/o subtitle) → MathVision

MathVision is estimated from Video-MME (w/o subtitle) with a linear curve fitted on 6 models measured on both: y = 1.4666·x + -0.4040, R² = 0.92, cross-validated error 4.5 pp. It is used for 0 estimates.

Fitted on

ModelVideo-MME (w/o subtitle)MathVision
Claude Opus 4.581.4%74.3%
Gemini 3 Pro87.7%86.6%
GPT-5.285.8%83.0%
Kimi K2.583.2%84.2%
LFM3-VL-2B62.8%51.6%
Qwen3.5 397B83.7%88.6%