benchgap
Calibration

RealWorldQA → RefCOCO (avg)

RefCOCO (avg) is estimated from RealWorldQA with a Michaelis–Menten curve fitted on 8 models measured on both: y = 1.1783·x / (0.25660 + x), R² = 0.37, cross-validated error 3.1 pp. It is used for 9 estimates.

Estimated modelRealWorldQARefCOCO (avg)Source
Qwen3.8-Flash-Next88.5%91.3%estimated ± 3.1 pp, low confidence
Qwen3.8-Omni-Flash87.7%91.2%estimated ± 3.1 pp, low confidence
Qwen3.7 Plus86.9%91.0%estimated ± 3.1 pp, low confidence
Qwen3.8-27B85.9%90.7%estimated ± 3.1 pp, low confidence
GPT-5.283.3%90.1%estimated ± 3.1 pp, medium confidence
Ternary Bonsai 2 27B80.1%89.3%estimated ± 3.1 pp, medium confidence
Claude Opus 4.577.0%88.4%estimated ± 3.1 pp, medium confidence
North Micro Vision Instruct62.2%83.4%estimated ± 3.1 pp, low confidence
LFM2.5-VL-450M58.4%81.9%estimated ± 3.1 pp, low confidence

Fitted on

ModelRealWorldQARefCOCO (avg)
Gemini 3 Pro83.3%84.1%
Kimi K2.581.0%87.8%
LFM2.5-VL-3B73.1%87.9%
LFM3-VL-2B79.3%90.5%
Qwen3.5 397B83.9%92.3%
Qwen3.6-27B84.1%92.5%
Qwen3.6-35B-A3B85.3%92.0%
ZAYA1-VL-8B65.0%84.3%