Calibration
Cookie-Bench → Chess Puzzles
Chess Puzzles is estimated from Cookie-Bench with a linear curve fitted on 5 models measured on both: y = 3.0245·x + -2.1013, R² = 0.90, cross-validated error 8.0 pp. It is used for 2 estimates.
| Estimated model | Cookie-Bench | Chess Puzzles | Source |
|---|---|---|---|
| Hy4 | 88.8% | 58.4% | estimated ± 8.0 pp, low confidence |
| ERNIE 5.5 Flash Preview | 88.2% | 56.6% | estimated ± 8.0 pp, low confidence |
Fitted on
| Model | Cookie-Bench | Chess Puzzles |
|---|---|---|
| Claude Opus 5.5 | 91.5% | 67.0% |
| DeepSeek V4.1 Flash 1017 | 87.9% | 46.0% |
| GLM-5.3 | 80.4% | 37.0% |
| GLM-5.3-Flash | 76.9% | 21.0% |
| GPT-6.1 Sol | 89.7% | 68.0% |