benchgap
Other · model

SWE-1.7 benchmark scores

As of 2026-11-22, SWE-1.7 (Other) has measured scores on 4 benchmarks and estimated scores on 24 more.

BenchmarkScoreSource
AA-SciCode56.6%estimated ± 3.5 pp, medium confidence
Terminal-Bench 2.181.5%measured
AA Coding Index74.5%estimated ± 2.3 pp, low confidence
SWE-bench Verified88.3%estimated ± 2.2 pp, medium confidence
SWE-bench Pro65.0%estimated ± 6.8 pp, medium confidence
Vals LiveCodeBench86.0%estimated ± 1.9 pp, high confidence
AA Terminal-Bench 2.181.7%estimated ± 2.6 pp, high confidence
CursorBench 3.259.4%estimated ± 1.6 pp, low confidence
Terminal-Bench 3.014.6%estimated ± 9.1 pp, low confidence
FrontierCode 1.1 Main42.3%measured
FrontierSWE v226.4%estimated ± 8.0 pp, low confidence
Terminal-Bench 4.118.6%estimated ± 10.9 pp, low confidence
Vals SWE-bench82.3%estimated ± 2.8 pp, high confidence
Terminal-Bench 2.1 (Vals AI)68.7%estimated ± 7.3 pp, medium confidence
Bug Hunt Bench21.2%estimated ± 8.9 pp, low confidence
CursorBench 4.046.5%estimated ± 3.3 pp, medium confidence
DeepSWE63.3%estimated ± 4.5 pp, low confidence
FrontierCode 2.015.5%measured
PostTrainBench v1.130.3%estimated ± 4.8 pp, high confidence
SWE Multilingual77.8%measured
VulcanBench Frontier v481.5%estimated ± 5.8 pp, low confidence
AA Terminal-Bench 4.04.3%estimated ± 11.0 pp, low confidence
cursorBench4134.6%estimated ± 6.0 pp, low confidence
Vibe Code Bench71.4%estimated ± 5.6 pp, low confidence
INCLUDE85.8%estimated ± 2.0 pp, medium confidence
MMLU-ProX85.8%estimated ± 1.3 pp, high confidence
PostTrainBench25.7%estimated ± 4.3 pp, medium confidence
ScarfBench1.1%estimated ± 5.0 pp, low confidence