benchgap
NVIDIA · model

Nemotron 3.5 Bolt 74B-A9B benchmark scores

As of 2026-10-29, Nemotron 3.5 Bolt 74B-A9B (NVIDIA) has measured scores on 12 benchmarks and estimated scores on 85 more.

BenchmarkScoreSource
AA-GPQA Diamond86.0%estimated ± 2.7 pp, high confidence
AA-HLE24.7%measured
AA-SciCode39.7%measured
CritPt4.3%measured
GDPval-AA24.0%measured
GPQA Diamond86.4%measured
HLE30.4%estimated ± 6.6 pp, medium confidence
AA-LCR69.7%measured
LiveCodeBench v680.4%estimated ± 4.9 pp, high confidence
SciCode39.9%estimated ± 3.1 pp, high confidence
Terminal-Bench 2.151.0%measured
BrowseComp66.8%measured
HLE w/ tools45.4%estimated ± 5.3 pp, low confidence
LongBench v260.2%estimated ± 5.8 pp, low confidence
VITA-Bench37.9%estimated ± 6.7 pp, low confidence
τ²-bench results91.4%estimated ± 11.5 pp, low confidence
AA Coding Index36.7%estimated ± 6.1 pp, medium confidence
APEX-Agents11.6%estimated ± 0.6 pp, low confidence
APEX-Agents-AA14.4%estimated ± 4.2 pp, high confidence
BioMysteryBench (human-difficult)35.5%estimated ± 6.8 pp, low confidence
DeepSearchQA78.6%estimated ± 7.3 pp, low confidence
SWE-bench Verified65.5%estimated ± 6.4 pp, medium confidence
AutomationBench20.7%estimated ± 10.5 pp, low confidence
BFCL v473.2%estimated ± 2.7 pp, high confidence
CyberGym50.9%estimated ± 6.0 pp, low confidence
JobBench26.8%estimated ± 6.4 pp, medium confidence
SWE-bench Pro43.3%estimated ± 6.6 pp, medium confidence
τ³-bench results17.0%measured
WideResearch70.9%estimated ± 3.5 pp, high confidence
AA Agentic Index18.3%estimated ± 2.9 pp, high confidence
MMLU-Pro84.9%estimated ± 2.5 pp, medium confidence
Artificial Analysis Intelligence Index20.8%estimated ± 5.8 pp, medium confidence
GPQA86.3%estimated ± 1.2 pp, high confidence
AA-Omniscience Accuracy29.3%estimated ± 7.8 pp, medium confidence
MMMLU88.2%estimated ± 0.7 pp, medium confidence
AA MMLU-Pro85.9%estimated ± 1.5 pp, high confidence
Gert Labs46.5%estimated ± 7.4 pp, medium confidence
AA EnterpriseOps-Gym33.4%estimated ± 3.3 pp, low confidence
AA Harvey LAB v1.087.2%estimated ± 9.8 pp, low confidence
AA Tau3 Banking26.6%estimated ± 3.9 pp, medium confidence
AA Terminal-Bench 2.160.2%estimated ± 6.8 pp, low confidence
ARC-AGI-183.1%estimated ± 2.7 pp, medium confidence
ARC-AGI-243.6%estimated ± 10.1 pp, low confidence
CursorBench 3.237.2%estimated ± 5.3 pp, low confidence
Terminal-Bench 3.03.7%estimated ± 9.1 pp, low confidence
FrontierCode 1.1 Main0.0%estimated ± 6.6 pp, low confidence
FrontierSWE v25.2%estimated ± 14.6 pp, low confidence
MazeBench0.4%estimated ± 5.4 pp, low confidence
OSWorld-Verified60.4%estimated ± 5.8 pp, medium confidence
Vals GPQA Diamond85.6%estimated ± 2.0 pp, high confidence
Vals MMLU-Pro84.6%estimated ± 1.6 pp, high confidence
Vals SWE-bench66.0%estimated ± 7.5 pp, low confidence
Terminal-Bench 2.1 (Vals AI)45.3%estimated ± 7.4 pp, low confidence
AA AutomationBench8.9%estimated ± 14.8 pp, low confidence
CWE-Bench-AA34.7%estimated ± 5.8 pp, medium confidence
AA Cyber Index33.0%estimated ± 13.3 pp, low confidence
DeepsecBench-AA0.8%estimated ± 8.6 pp, low confidence
GDP.pdf6.5%estimated ± 4.9 pp, low confidence
AA ITBench39.7%estimated ± 4.1 pp, high confidence
AA Terminal-Bench 4.01.4%estimated ± 11.6 pp, low confidence
CWE-bench v133.4%estimated ± 6.4 pp, low confidence
DeepSWE29.8%estimated ± 7.5 pp, low confidence
HLE w/o tools25.3%measured
PostTrainBench v1.125.5%estimated ± 7.4 pp, low confidence
Toolathlon-Verified49.9%estimated ± 3.1 pp, medium confidence
ARC-AGI-30.0%estimated ± 3.6 pp, medium confidence
ARC-AGI-3 Provider Adapter2.8%estimated ± 7.5 pp, low confidence
Hermes Bench54.8%estimated ± 2.9 pp, high confidence
Hermes Index22.1%estimated ± 8.7 pp, medium confidence
ExploitGym0.8%estimated ± 10.9 pp, low confidence
C-Eval95.0%estimated ± 1.1 pp, low confidence
Claw-Eval63.4%estimated ± 6.3 pp, low confidence
DeepPlanning35.8%estimated ± 13.1 pp, low confidence
MCP Atlas52.2%measured
MCP-Tasks75.4%estimated ± 0.6 pp, low confidence
MMLU-Redux92.1%estimated ± 2.8 pp, high confidence
NL2Repo31.6%estimated ± 7.4 pp, medium confidence
QwenClawBench54.3%estimated ± 2.6 pp, high confidence
SuperGPQA70.5%estimated ± 13.9 pp, low confidence
Toolathlon37.2%estimated ± 4.2 pp, high confidence
HealthBench Hard22.4%estimated ± 8.6 pp, low confidence
MedXpertQA (Text)44.7%estimated ± 4.5 pp, low confidence
MMLU-Pro (Arcee)85.6%estimated ± 3.4 pp, medium confidence
React Native Evals72.3%estimated ± 4.7 pp, medium confidence
ResearchClawBench16.4%estimated ± 1.8 pp, medium confidence
BioMysteryBench (human-solvable)81.8%estimated ± 0.6 pp, low confidence
DRACO71.4%estimated ± 3.1 pp, medium confidence
HealthBench (raw)33.2%estimated ± 6.0 pp, low confidence
HealthBench (length-adjusted)47.8%estimated ± 3.4 pp, low confidence
HealthBench Professional58.1%estimated ± 4.5 pp, low confidence
HealthBench Professional (raw)44.8%estimated ± 4.5 pp, medium confidence
STEMBench2.4%estimated ± 0.2 pp, medium confidence
Agents' Last Exam15.8%estimated ± 13.0 pp, low confidence
OpenHarmony Bench51.0%estimated ± 2.4 pp, medium confidence
MRCRv272.9%estimated ± 11.3 pp, low confidence
MMLongBench-Doc60.9%estimated ± 2.6 pp, low confidence
PinchBench87.8%measured