benchgap
Calibration

MathVision w/ Python → CharXiv

CharXiv is estimated from MathVision w/ Python with a Michaelis–Menten + offset curve fitted on 6 models measured on both: y = 0.0000 + 2.0000·x / (1.15016 + x), R² = 0.44, cross-validated error 1.1 pp. It is used for 0 estimates.

Fitted on

ModelMathVision w/ PythonCharXiv
Kimi K397.8%91.3%
LongCat-2.596.5%90.2%
Qwen3.8-27B94.6%90.2%
Qwen3.8-Flash-Next95.7%90.6%
Qwen3.8 Max97.7%93.5%
Qwen3.8-Omni-Flash96.2%91.4%