benchgap
Calibration

LVBench → CharXiv w/o tools

CharXiv w/o tools is estimated from LVBench with a Michaelis–Menten curve fitted on 6 models measured on both: y = 1.0953·x / (0.22978 + x), R² = 0.94, cross-validated error 2.5 pp. It is used for 1 estimate.

Estimated modelLVBenchCharXiv w/o toolsSource
Gemini 4 Argon91.7%87.6%estimated ± 2.5 pp, low confidence

Fitted on

ModelLVBenchCharXiv w/o tools
Gemini 3.7 Flash85.4%84.5%
Gemini 3.8 Flash87.1%86.2%
LFM3-VL-2B41.2%70.2%
Qwen3.8-Flash-Next76.6%84.6%
Qwen3.8 Max81.8%88.4%
Qwen3.8-Omni-Flash76.9%83.5%