benchgap
Calibration

ERQA → AA-MMMU-Pro

AA-MMMU-Pro is estimated from ERQA with a linear curve fitted on 8 models measured on both: y = 0.4439·x + 0.4920, R² = 0.70, cross-validated error 2.2 pp. It is used for 3 estimates.

Estimated modelERQAAA-MMMU-ProSource
Grok 4.2054.1%73.2%estimated ± 2.2 pp, high confidence
Seed 2.1 Pro72.0%81.2%estimated ± 2.2 pp, high confidence
Seed 2.1 Turbo71.3%80.9%estimated ± 2.2 pp, high confidence