benchgap
Other · model

Ornith-1.0-397B benchmark scores

As of 2026-11-22, Ornith-1.0-397B (Other) has measured scores on 6 benchmarks and estimated scores on 37 more.

BenchmarkScoreSource
AA-SciCode49.5%estimated ± 3.1 pp, high confidence
LiveCodeBench v691.6%estimated ± 1.7 pp, high confidence
SciCode48.7%estimated ± 3.6 pp, medium confidence
Terminal-Bench 2.177.5%measured
VITA-Bench54.9%estimated ± 10.7 pp, low confidence
AA Coding Index66.9%estimated ± 4.3 pp, high confidence
SWE-bench Verified82.4%measured
JobBench57.8%estimated ± 9.3 pp, low confidence
SWE-bench Pro62.2%measured
Vals LiveCodeBench85.5%estimated ± 4.7 pp, medium confidence
AA Terminal-Bench 2.181.7%estimated ± 2.6 pp, high confidence
CursorBench 3.156.1%estimated ± 5.6 pp, low confidence
CursorBench 3.260.8%estimated ± 3.6 pp, high confidence
Terminal-Bench 3.011.7%estimated ± 9.1 pp, low confidence
FrontierCode 1.1 Main31.7%estimated ± 4.2 pp, medium confidence
FrontierSWE v219.4%estimated ± 8.3 pp, medium confidence
OSWorld-Verified73.8%estimated ± 3.8 pp, low confidence
Terminal-Bench 4.114.7%estimated ± 10.9 pp, low confidence
Vals SWE-bench81.9%estimated ± 5.2 pp, medium confidence
Terminal-Bench 2.1 (Vals AI)65.7%estimated ± 7.3 pp, medium confidence
Bug Hunt Bench15.0%estimated ± 7.2 pp, low confidence
CursorBench 4.037.2%estimated ± 3.3 pp, medium confidence
DeepSWE47.4%estimated ± 8.7 pp, medium confidence
FrontierCode 2.021.9%estimated ± 6.7 pp, medium confidence
PostTrainBench v1.127.0%estimated ± 4.4 pp, high confidence
SWE Multilingual78.9%measured
VulcanBench Frontier v480.9%estimated ± 8.3 pp, low confidence
AA Terminal-Bench 4.04.3%estimated ± 11.0 pp, low confidence
Vibe Code Bench62.8%estimated ± 8.4 pp, medium confidence
Claw-Eval77.1%measured
INCLUDE86.1%estimated ± 2.0 pp, medium confidence
MCP Atlas76.2%estimated ± 13.5 pp, low confidence
MMLU-ProX86.3%estimated ± 1.3 pp, medium confidence
NL2Repo48.2%measured
PostTrainBench v127.5%estimated ± 4.6 pp, high confidence
LiveCodeBench Pro85.4%estimated ± 6.0 pp, low confidence
React Native Evals80.7%estimated ± 2.7 pp, medium confidence
ResearchClawBench20.6%estimated ± 1.3 pp, medium confidence
SWE-Rebench61.8%estimated ± 3.6 pp, medium confidence
PostTrainBench24.9%estimated ± 3.7 pp, high confidence
FrontierCode 1.1 Extended56.7%estimated ± 3.0 pp, low confidence
LiveCodeBench80.7%estimated ± 14.6 pp, low confidence
OpenHarmony Bench v1.055.4%estimated ± 2.7 pp, high confidence