Calibration
RealWorldQA → SimpleVQA
SimpleVQA is estimated from RealWorldQA with a Hill curve fitted on 5 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.82705^6.00 + x^6.00), R² = 0.78, cross-validated error 9.5 pp. It is used for 4 estimates.
| Estimated model | RealWorldQA | SimpleVQA | Source |
|---|---|---|---|
| LFM2.5-VL-450M | 58.4% | 13.3% | estimated ± 9.5 pp, low confidence |
| North Micro Vision Instruct | 62.2% | 18.4% | estimated ± 9.5 pp, low confidence |
| Ternary Bonsai 2 27B | 80.1% | 54.3% | estimated ± 9.5 pp, low confidence |
| ZAYA1-VL-8B | 65.0% | 22.9% | estimated ± 9.5 pp, low confidence |