benchgap
Calibration

Video-MME (with subtitle) → V*

V* is estimated from Video-MME (with subtitle) with a Hill curve fitted on 5 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.73868^6.00 + x^6.00), R² = 0.68, cross-validated error 7.8 pp. It is used for 3 estimates.

Estimated modelVideo-MME (with subtitle)V*Source
MiMo-V2.587.7%88.4%estimated ± 7.8 pp, low confidence
Qwen3.6-35B-A3B86.6%86.6%estimated ± 7.8 pp, low confidence
MiniMax M385.4%84.6%estimated ± 7.8 pp, low confidence