benchgap
Other · model

Ternary Bonsai 2 27B benchmark scores

As of 2026-10-07, Ternary Bonsai 2 27B (Other) has measured scores on 14 benchmarks and estimated scores on 54 more.

BenchmarkScoreSource
AA-GPQA Diamond84.3%estimated ± 5.4 pp, medium confidence
AA-HLE26.8%estimated ± 4.0 pp, high confidence
AA-SciCode47.2%estimated ± 3.7 pp, high confidence
AIME2695.8%measured
Artificial Analysis Intelligence Index18.0%estimated ± 4.2 pp, medium confidence
CritPt2.1%estimated ± 4.1 pp, high confidence
GDPval-AA13.2%estimated ± 12.5 pp, low confidence
GPQA Diamond85.8%measured
HLE18.7%estimated ± 5.9 pp, low confidence
IFBench74.0%measured
AA-LCR77.0%measured
LiveCodeBench v690.1%measured
AA-Omniscience Accuracy11.7%estimated ± 4.5 pp, medium confidence
SciCode39.1%estimated ± 3.8 pp, high confidence
Terminal-Bench 2.152.8%measured
IFEval91.3%measured
LongBench v261.5%estimated ± 5.9 pp, medium confidence
τ²-bench results80.2%measured
AA Coding Index29.4%estimated ± 5.1 pp, medium confidence
AA-MMMU-Pro67.4%estimated ± 1.9 pp, low confidence
APEX-Agents-AA1.6%estimated ± 11.4 pp, low confidence
SWE-bench Verified60.8%measured
BFCL v456.8%estimated ± 9.8 pp, low confidence
SWE-bench Pro34.9%estimated ± 3.2 pp, high confidence
AA Agentic Index19.1%estimated ± 12.3 pp, low confidence
MMLU-Pro77.9%estimated ± 1.4 pp, high confidence
GPQA85.8%measured
AA-IFBench57.0%estimated ± 8.2 pp, medium confidence
AA EnterpriseOps-Gym22.9%estimated ± 3.6 pp, low confidence
ARC-AGI-182.0%estimated ± 2.7 pp, medium confidence
ARC-AGI-241.8%estimated ± 10.1 pp, low confidence
Terminal-Bench 3.04.0%estimated ± 9.1 pp, low confidence
FrontierCode 1.1 Main0.4%estimated ± 2.7 pp, low confidence
Vals GPQA Diamond84.9%estimated ± 2.0 pp, high confidence
Vals LiveCodeBench47.4%estimated ± 9.9 pp, low confidence
Vals MMLU-Pro82.9%estimated ± 1.2 pp, high confidence
Vals SWE-bench50.0%estimated ± 6.8 pp, low confidence
Terminal-Bench 2.1 (Vals AI)46.7%estimated ± 7.4 pp, low confidence
AA ITBench58.1%estimated ± 3.6 pp, low confidence
AA Terminal-Bench 2.152.2%estimated ± 3.5 pp, high confidence
AA Terminal-Bench 4.00.0%estimated ± 8.9 pp, medium confidence
HLE w/o tools22.5%estimated ± 4.4 pp, high confidence
Vibe Code Bench0.6%estimated ± 8.1 pp, low confidence
CharXiv65.0%estimated ± 4.1 pp, low confidence
C-Eval90.8%estimated ± 0.9 pp, low confidence
HMMT Feb 202596.1%estimated ± 1.9 pp, low confidence
HMMT Feb 202687.2%estimated ± 4.0 pp, high confidence
MCP-Tasks75.7%estimated ± 8.2 pp, low confidence
MMAnswerBench84.2%estimated ± 1.3 pp, high confidence
MMLU-Redux89.1%measured
MMMU-Pro61.8%estimated ± 11.4 pp, low confidence
NL2Repo46.4%estimated ± 3.1 pp, low confidence
SuperGPQA58.2%estimated ± 4.5 pp, high confidence
ERQA55.4%estimated ± 3.2 pp, low confidence
HealthBench Hard0.0%estimated ± 5.1 pp, low confidence
MedXpertQA (Text)43.2%estimated ± 4.5 pp, low confidence
MMLU-Pro (Arcee)85.4%estimated ± 3.4 pp, medium confidence
SWE-Rebench57.0%estimated ± 3.6 pp, low confidence
ARC-AGI-30.0%estimated ± 2.1 pp, medium confidence
HealthBench Professional42.0%estimated ± 4.8 pp, low confidence
AIME 202595.0%measured
MMMU68.8%estimated ± 6.6 pp, low confidence
LiveCodeBench73.3%estimated ± 10.2 pp, low confidence
SimpleVQA54.3%estimated ± 9.5 pp, low confidence
MMMLU88.1%estimated ± 1.1 pp, medium confidence
MMLU90.3%estimated ± 3.6 pp, low confidence
MATH-50098.8%measured
RealWorldQA80.1%measured