Calibration
Terminal-Bench 3.0 → Terminal-Bench 2.1
Terminal-Bench 2.1 is estimated from Terminal-Bench 3.0 with a linear curve fitted on 11 models measured on both: y = 0.3715·x + 0.7596, R² = 0.31, cross-validated error 6.6 pp. It is used for 2 estimates.
| Estimated model | Terminal-Bench 3.0 | Terminal-Bench 2.1 | Source |
|---|---|---|---|
| Claude Opus 5 | 42.7% | 91.8% | estimated ± 6.6 pp, low confidence |
| Grok 4.6 | 26.5% | 85.8% | estimated ± 6.6 pp, low confidence |