benchgap
Calibration

VideoMMMU → ERQA

ERQA is estimated from VideoMMMU with a Michaelis–Menten + offset curve fitted on 8 models measured on both: y = 0.1321 + 2.0000·x / (2.44830 + x), R² = 0.36, cross-validated error 9.6 pp. It is used for 0 estimates.

Fitted on

ModelVideoMMMUERQA
Claude Opus 4.584.4%46.8%
Gemini 3 Pro87.6%70.5%
GPT-5.285.9%59.8%
LFM3-VL-2B49.6%48.2%
Qwen3.5 397B84.7%67.5%
Qwen3.6-27B84.4%62.5%
Qwen3.7 Plus85.4%69.8%
Qwen3.8 Max88.7%77.8%