benchgap
Calibration

Cookie-Bench → Mystery Game Puzzles

Mystery Game Puzzles is estimated from Cookie-Bench with a linear curve fitted on 5 models measured on both: y = 4.3708·x + -3.2454, R² = 0.90, cross-validated error 12.6 pp. It is used for 2 estimates.

Estimated modelCookie-BenchMystery Game PuzzlesSource
Hy488.8%63.6%estimated ± 12.6 pp, low confidence
ERNIE 5.5 Flash Preview88.2%61.0%estimated ± 12.6 pp, low confidence

Fitted on

ModelCookie-BenchMystery Game Puzzles
Claude Opus 5.591.5%71.0%
DeepSeek V4.1 Flash 101787.9%49.0%
GLM-5.380.4%33.0%
GLM-5.3-Flash76.9%8.0%
GPT-6.1 Sol89.7%80.0%