Calibration
RealWorldQA → RefCOCO (avg)
RefCOCO (avg) is estimated from RealWorldQA with a Michaelis–Menten curve fitted on 8 models measured on both: y = 1.1783·x / (0.25660 + x), R² = 0.37, cross-validated error 3.1 pp. It is used for 9 estimates.
| Estimated model | RealWorldQA | RefCOCO (avg) | Source |
|---|---|---|---|
| Qwen3.8-Flash-Next | 88.5% | 91.3% | estimated ± 3.1 pp, low confidence |
| Qwen3.8-Omni-Flash | 87.7% | 91.2% | estimated ± 3.1 pp, low confidence |
| Qwen3.7 Plus | 86.9% | 91.0% | estimated ± 3.1 pp, low confidence |
| Qwen3.8-27B | 85.9% | 90.7% | estimated ± 3.1 pp, low confidence |
| GPT-5.2 | 83.3% | 90.1% | estimated ± 3.1 pp, medium confidence |
| Ternary Bonsai 2 27B | 80.1% | 89.3% | estimated ± 3.1 pp, medium confidence |
| Claude Opus 4.5 | 77.0% | 88.4% | estimated ± 3.1 pp, medium confidence |
| North Micro Vision Instruct | 62.2% | 83.4% | estimated ± 3.1 pp, low confidence |
| LFM2.5-VL-450M | 58.4% | 81.9% | estimated ± 3.1 pp, low confidence |
Fitted on
| Model | RealWorldQA | RefCOCO (avg) |
|---|---|---|
| Gemini 3 Pro | 83.3% | 84.1% |
| Kimi K2.5 | 81.0% | 87.8% |
| LFM2.5-VL-3B | 73.1% | 87.9% |
| LFM3-VL-2B | 79.3% | 90.5% |
| Qwen3.5 397B | 83.9% | 92.3% |
| Qwen3.6-27B | 84.1% | 92.5% |
| Qwen3.6-35B-A3B | 85.3% | 92.0% |
| ZAYA1-VL-8B | 65.0% | 84.3% |