benchgap
Calibration

Video-MME (with subtitle) → ERQA

ERQA is estimated from Video-MME (with subtitle) with a Hill curve fitted on 7 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.84086^6.00 + x^6.00), R² = 0.87, cross-validated error 3.9 pp. It is used for 3 estimates.

Estimated modelVideo-MME (with subtitle)ERQASource
MiMo-V2.587.7%67.5%estimated ± 3.9 pp, medium confidence
Qwen3.6-35B-A3B86.6%65.3%estimated ± 3.9 pp, medium confidence
MiniMax M385.4%62.8%estimated ± 3.9 pp, medium confidence