benchgap
Other · model

SWE-2 benchmark scores

As of 2026-11-21, SWE-2 (Other) has measured scores on 5 benchmarks and estimated scores on 25 more.

BenchmarkScoreSource
AA-SciCode56.7%estimated ± 3.5 pp, medium confidence
SciCode61.0%estimated ± 7.6 pp, low confidence
Terminal-Bench 2.192.8%measured
AA Coding Index76.9%estimated ± 2.3 pp, low confidence
SWE-bench Verified92.2%estimated ± 2.2 pp, medium confidence
SWE-bench Pro77.3%estimated ± 6.8 pp, medium confidence
Vals LiveCodeBench88.1%estimated ± 1.9 pp, high confidence
AA Terminal-Bench 2.186.2%estimated ± 2.6 pp, medium confidence
CursorBench 3.266.7%estimated ± 1.6 pp, medium confidence
Terminal-Bench 3.036.4%estimated ± 9.1 pp, low confidence
FrontierCode 1.1 Main50.0%measured
FrontierSWE v238.3%estimated ± 8.0 pp, medium confidence
Terminal-Bench 4.118.6%estimated ± 4.6 pp, high confidence
Vals SWE-bench90.9%estimated ± 2.8 pp, high confidence
Terminal-Bench 2.1 (Vals AI)77.3%estimated ± 7.3 pp, low confidence
Bug Hunt Bench31.1%estimated ± 8.9 pp, medium confidence
CursorBench 4.047.2%estimated ± 3.3 pp, high confidence
DeepSWE73.0%measured
FrontierCode 2.024.1%measured
PostTrainBench v1.141.1%estimated ± 4.5 pp, high confidence
Terminal-Bench 4.027.3%measured
Terminal-Bench-Science 0.12.4%estimated ± 14.2 pp, low confidence
VulcanBench Frontier v489.1%estimated ± 5.0 pp, high confidence
AA Terminal-Bench 4.025.1%estimated ± 6.3 pp, low confidence
cursorBench4145.1%estimated ± 6.0 pp, low confidence
Vibe Code Bench78.2%estimated ± 5.6 pp, low confidence
NL2Repo62.1%estimated ± 6.0 pp, medium confidence
PostTrainBench35.0%estimated ± 4.3 pp, medium confidence
ScarfBench68.1%estimated ± 3.8 pp, medium confidence
SWE-Atlas Codebase QnA61.3%estimated ± 4.8 pp, high confidence