benchgap
Calibration

RealWorldQA → SimpleVQA

SimpleVQA is estimated from RealWorldQA with a Hill curve fitted on 11 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.81515^6.00 + x^6.00), R² = 0.46, cross-validated error 12.3 pp. It is used for 2 estimates.

Estimated modelRealWorldQASimpleVQASource
Ternary Bonsai 2 27B80.1%56.9%estimated ± 12.3 pp, low confidence
North Micro Vision Instruct62.2%19.8%estimated ± 12.3 pp, low confidence

Fitted on

ModelRealWorldQASimpleVQA
Claude Opus 4.577.0%65.7%
Gemini 3 Pro83.3%73.2%
GPT-5.283.3%55.8%
Kimi K2.581.0%71.2%
LFM2.5-VL-3B73.1%35.4%
LFM3-VL-2B79.3%36.3%
Qwen3.5 397B83.9%67.1%
Qwen3.6-27B84.1%56.1%
Qwen3.6-35B-A3B85.3%58.9%
Qwen3.7 Plus86.9%81.7%
Qwen3.8 Max88.0%75.0%