benchgap
Calibration

MathVision w/ Python → CharXiv w/o tools

CharXiv w/o tools is estimated from MathVision w/ Python with a Michaelis–Menten + offset curve fitted on 5 models measured on both: y = 0.0000 + 2.0000·x / (1.30412 + x), R² = 0.33, cross-validated error 1.9 pp. It is used for 1 estimate.

Estimated modelMathVision w/ PythonCharXiv w/o toolsSource
LongCat-2.596.5%85.1%estimated ± 1.9 pp, low confidence

Fitted on

ModelMathVision w/ PythonCharXiv w/o tools
Kimi K397.8%84.8%
Qwen3.8-27B94.6%83.7%
Qwen3.8-Flash-Next95.7%84.6%
Qwen3.8 Max97.7%88.4%
Qwen3.8-Omni-Flash96.2%83.5%