Calibration
ProgramBench → CursorBench 3.2
CursorBench 3.2 is estimated from ProgramBench with a Michaelis–Menten curve fitted on 5 models measured on both: y = 2.0000·x / (1.66105 + x), R² = 0.92, cross-validated error 3.6 pp. It is used for 8 estimates.
| Estimated model | ProgramBench | CursorBench 3.2 | Source |
|---|---|---|---|
| Step 5 Preview | 80.5% | 65.3% | estimated ± 3.6 pp, medium confidence |
| Qwen4 Max | 31.5% | 31.9% | estimated ± 3.6 pp, low confidence |
| Hy4 | 30.0% | 30.6% | estimated ± 3.6 pp, low confidence |
| ERNIE 5.5 Flash Preview | 29.5% | 30.2% | estimated ± 3.6 pp, low confidence |
| MiMo-V2.6-Pro | 26.5% | 27.5% | estimated ± 3.6 pp, low confidence |
| MiMo-V2.6-Flash | 26.0% | 27.1% | estimated ± 3.6 pp, low confidence |
| LongCat-2.5 | 25.5% | 26.6% | estimated ± 3.6 pp, low confidence |
| Hy4 flash | 16.0% | 17.6% | estimated ± 3.6 pp, low confidence |
Fitted on
| Model | ProgramBench | CursorBench 3.2 |
|---|---|---|
| Claude Fable 5.1 | 87.6% | 73.4% |
| Claude Opus 5 | 93.0% | 70.0% |
| GLM-5.2 | 63.7% | 55.0% |
| Kimi K2.7 Code | 53.6% | 49.7% |
| Kimi K3 | 77.8% | 60.8% |