Calibration
OSWorld 2.0 → Gert Labs
Gert Labs is estimated from OSWorld 2.0 with a Michaelis–Menten curve fitted on 5 models measured on both: y = 0.7869·x / (0.01843 + x), R² = 0.82, cross-validated error 3.7 pp. It is used for 9 estimates.
| Estimated model | OSWorld 2.0 | Gert Labs | Source |
|---|---|---|---|
| Claude Opus 4.7 (Adaptive) | 18.2% | 71.5% | estimated ± 3.7 pp, medium confidence |
| Claude Opus 5.5 | 48.7% | 75.8% | estimated ± 3.7 pp, low confidence |
| Gemini 4 Argon | 69.2% | 76.7% | estimated ± 3.7 pp, low confidence |
| GPT-6 Sol | 60.5% | 76.4% | estimated ± 3.7 pp, low confidence |
| MiniMax M3 | 4.6% | 56.2% | estimated ± 3.7 pp, medium confidence |
| Muse Spark 1.1 | 14.2% | 69.7% | estimated ± 3.7 pp, medium confidence |
| Qwen3.7 Plus | 2.8% | 47.5% | estimated ± 3.7 pp, low confidence |
| Qwen3.8-Flash-Next | 19.4% | 71.9% | estimated ± 3.7 pp, medium confidence |
| Qwen3.8 Max | 19.4% | 71.9% | estimated ± 3.7 pp, medium confidence |