Calibration
Toolathlon-Verified → CyberGym
CyberGym is estimated from Toolathlon-Verified with a Hill curve fitted on 7 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.63437^6.00 + x^6.00), R² = 0.40, cross-validated error 6.0 pp. It is used for 6 estimates.
| Estimated model | Toolathlon-Verified | CyberGym | Source |
|---|---|---|---|
| Claude Sonnet 5.5 | 77.8% | 92.7% | estimated ± 6.0 pp, low confidence |
| Ornith-1.5-397B | 71.2% | 80.0% | estimated ± 6.0 pp, low confidence |
| dots3-note Preview | 55.6% | 37.4% | estimated ± 6.0 pp, low confidence |
| Laguna S 2.1 | 49.7% | 22.5% | estimated ± 6.0 pp, low confidence |
| Ornith-1.5-35B-A3B | 48.7% | 20.4% | estimated ± 6.0 pp, low confidence |
| Ornith-1.5-9B | 41.2% | 8.4% | estimated ± 6.0 pp, low confidence |