benchgap
Calibration

ZeroBench → MathVision

MathVision is estimated from ZeroBench with a Hill curve fitted on 5 models measured on both: y = 0.8941 + (1.2000 − 0.8941)·x^6.00 / (0.30847^6.00 + x^6.00), R² = 0.59, cross-validated error 2.7 pp. It is used for 2 estimates.

Estimated modelZeroBenchMathVisionSource
Gemini 3.1 Pro29.0%100.0%estimated ± 2.7 pp, low confidence
Muse Spark33.0%100.0%estimated ± 2.7 pp, low confidence

Fitted on

ModelZeroBenchMathVision
dots3-note Preview19.0%87.7%
Kimi K323.0%94.3%
Qwen3.8 Max24.0%95.2%
Seed 2.1 Pro18.0%92.6%
Seed 2.1 Turbo11.0%90.1%