Calibration
OSWorld 2.0 → OSWorld-Verified
OSWorld-Verified is estimated from OSWorld 2.0 with a linear curve fitted on 9 models measured on both: y = 0.7145·x + 0.6889, R² = 0.80, cross-validated error 3.0 pp. It is used for 4 estimates.
| Estimated model | OSWorld 2.0 | OSWorld-Verified | Source |
|---|---|---|---|
| Claude Opus 5.5 | 48.7% | 100.0% | estimated ± 3.0 pp, medium confidence |
| Gemini 4 Argon | 69.2% | 100.0% | estimated ± 3.0 pp, medium confidence |
| GPT-6 Sol | 60.5% | 100.0% | estimated ± 3.0 pp, medium confidence |
| Qwen3.8-Flash-Next | 19.4% | 82.8% | estimated ± 3.0 pp, high confidence |