Calibration
Hermes Bench → ExploitGym
ExploitGym is estimated from Hermes Bench with a Hill curve fitted on 6 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.90218^6.00 + x^6.00), R² = 0.33, cross-validated error 10.8 pp. It is used for 0 estimates.
Fitted on
| Model | Hermes Bench | ExploitGym |
|---|---|---|
| Claude Opus 5.5 | 76.7% | 33.3% |
| GLM-5.3 | 71.8% | 15.0% |
| GPT-6.1 Sol | 73.9% | 35.1% |
| GPT-6 Astra | 73.7% | 42.4% |
| GPT-6 Luna | 70.5% | 11.6% |
| GPT-6 Sol | 73.5% | 22.1% |