benchgap
Other · model

Ember-1 benchmark scores

As of 2026-11-21, Ember-1 (Other) has measured scores on 4 benchmarks and estimated scores on 27 more.

BenchmarkScoreSource
AA-SciCode53.8%estimated ± 3.8 pp, high confidence
SciCode53.0%estimated ± 3.6 pp, medium confidence
Terminal-Bench 2.182.0%measured
AA Coding Index77.8%estimated ± 2.5 pp, high confidence
SWE-bench Verified92.2%measured
SWE-bench Pro72.0%estimated ± 4.5 pp, high confidence
Vals LiveCodeBench90.8%estimated ± 10.0 pp, low confidence
AA Terminal-Bench 2.181.7%estimated ± 2.6 pp, high confidence
CursorBench 3.268.2%estimated ± 6.4 pp, low confidence
Terminal-Bench 3.021.4%estimated ± 3.2 pp, high confidence
FrontierCode 1.1 Main52.5%estimated ± 3.5 pp, low confidence
Terminal-Bench 4.121.8%measured
Terminal-Bench Hard58.5%estimated ± 2.8 pp, medium confidence
Vals SWE-bench92.5%estimated ± 6.6 pp, medium confidence
Terminal-Bench 2.1 (Vals AI)69.1%estimated ± 7.3 pp, medium confidence
Bug Hunt Bench37.7%estimated ± 10.4 pp, low confidence
DeepSWE75.2%measured
FrontierCode 2.032.3%estimated ± 10.2 pp, low confidence
PostTrainBench v1.143.6%estimated ± 4.5 pp, high confidence
Terminal-Bench 4.028.1%estimated ± 4.5 pp, high confidence
Terminal-Bench-Science 0.10.0%estimated ± 10.7 pp, low confidence
VulcanBench Frontier v490.6%estimated ± 5.0 pp, high confidence
AA Terminal-Bench 4.021.4%estimated ± 6.2 pp, medium confidence
Vibe Code Bench66.3%estimated ± 8.4 pp, low confidence
NL2Repo63.0%estimated ± 6.0 pp, medium confidence
PostTrainBench v135.4%estimated ± 5.5 pp, low confidence
React Native Evals85.1%estimated ± 2.7 pp, low confidence
SWE-Rebench61.8%estimated ± 3.6 pp, low confidence
ScarfBench69.4%estimated ± 3.8 pp, medium confidence
LiveCodeBench86.2%estimated ± 14.6 pp, low confidence
SWE-Atlas Codebase QnA61.7%estimated ± 4.8 pp, high confidence