Calibration
OSWorld 2.0 → ExploitGym
ExploitGym is estimated from OSWorld 2.0 with a Michaelis–Menten curve fitted on 10 models measured on both: y = 1.1202·x / (1.78710 + x), R² = 0.55, cross-validated error 10.4 pp. It is used for 2 estimates.
| Estimated model | OSWorld 2.0 | ExploitGym | Source |
|---|---|---|---|
| Qwen3.8-Flash-Next | 19.4% | 11.0% | estimated ± 10.4 pp, low confidence |
| Qwen3.7 Plus | 2.8% | 1.7% | estimated ± 10.4 pp, low confidence |
Fitted on
| Model | OSWorld 2.0 | ExploitGym |
|---|---|---|
| Claude Opus 5.5 | 48.7% | 33.3% |
| Gemini 4 Argon | 69.2% | 39.5% |
| GPT-5.5 | 13.0% | 13.4% |
| GPT-5.6 Luna | 45.6% | 12.4% |
| GPT-5.6 Sol | 62.6% | 33.7% |
| GPT-5.6 Terra | 50.2% | 23.2% |
| GPT-6 Astra | 72.6% | 42.4% |
| GPT-6 Sol | 60.5% | 22.1% |
| Kimi K3.1 Pro | 79.6% | 20.7% |
| Muse Spark 1.1 | 14.2% | 0.8% |