benchgap
Calibration

Video-MME (with subtitle) → CharXiv

CharXiv is estimated from Video-MME (with subtitle) with a Hill curve fitted on 10 models measured on both: y = 0.3734 + (1.2000 − 0.3734)·x^6.00 / (0.85282^6.00 + x^6.00), R² = 0.67, cross-validated error 4.9 pp. It is used for 1 estimate.

Estimated modelVideo-MME (with subtitle)CharXivSource
MiniMax M385.4%78.8%estimated ± 4.9 pp, high confidence