benchgap
Calibration

Hermes Bench → ExploitGym

ExploitGym is estimated from Hermes Bench with a Hill curve fitted on 6 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.90218^6.00 + x^6.00), R² = 0.33, cross-validated error 10.8 pp. It is used for 0 estimates.

Fitted on

ModelHermes BenchExploitGym
Claude Opus 5.576.7%33.3%
GLM-5.371.8%15.0%
GPT-6.1 Sol73.9%35.1%
GPT-6 Astra73.7%42.4%
GPT-6 Luna70.5%11.6%
GPT-6 Sol73.5%22.1%