Calibration
CyberGym → JobBench
JobBench is estimated from CyberGym with a Michaelis–Menten curve fitted on 12 models measured on both: y = 2.0000·x / (2.35768 + x), R² = 0.44, cross-validated error 8.6 pp. It is used for 5 estimates.
| Estimated model | CyberGym | JobBench | Source |
|---|---|---|---|
| Claude Mythos 5 | 83.8% | 52.4% | estimated ± 8.6 pp, low confidence |
| Claude Mythos Preview | 83.1% | 52.1% | estimated ± 8.6 pp, low confidence |
| Gemini 3.5 Flash Cyber | 83.2% | 52.2% | estimated ± 8.6 pp, low confidence |
| Gemini 3.8 Flash Cyber | 86.2% | 53.5% | estimated ± 8.6 pp, low confidence |
| Fugu Cyber | 86.9% | 53.9% | estimated ± 8.6 pp, low confidence |