benchgap
Calibration

Vals LiveCodeBench → CursorBench 3.2

CursorBench 3.2 is estimated from Vals LiveCodeBench with a offset logistic curve fitted on 16 models measured on both: y = 0.5910 + (0.7302 − 0.5910) / (1 + exp(−200.00·(x − 0.8875))), R² = 0.40, cross-validated error 7.2 pp. It is used for 5 estimates.

Estimated modelVals LiveCodeBenchCursorBench 3.2Source
GLM-4.567.4%59.1%estimated ± 7.2 pp, low confidence
GLM-4.681.0%59.1%estimated ± 7.2 pp, low confidence
GPT-5.1-Codex85.6%59.1%estimated ± 7.2 pp, low confidence
GPT-5.1-Codex-Max83.6%59.1%estimated ± 7.2 pp, low confidence
Grok Code Fast 162.0%59.1%estimated ± 7.2 pp, low confidence