benchgap
NVIDIA · model

Nemotron 3.5 Bolt 74B-A9B BF16 benchmark scores

As of 2026-10-29, Nemotron 3.5 Bolt 74B-A9B BF16 (NVIDIA) has measured scores on 9 benchmarks and estimated scores on 63 more.

BenchmarkScoreSource
AA-GPQA Diamond87.2%estimated ± 2.7 pp, high confidence
AA-HLE32.2%estimated ± 3.8 pp, high confidence
CritPt9.0%estimated ± 4.6 pp, high confidence
GDPval-AA28.2%estimated ± 7.7 pp, medium confidence
GPQA Diamond88.8%measured
HLE34.4%estimated ± 6.6 pp, medium confidence
AA-LCR67.4%measured
Terminal-Bench 2.153.9%measured
BrowseComp70.0%measured
HLE w/ tools48.4%estimated ± 5.8 pp, medium confidence
LongBench v259.8%estimated ± 5.8 pp, low confidence
VITA-Bench40.2%estimated ± 6.7 pp, low confidence
τ²-bench results92.1%estimated ± 11.5 pp, low confidence
APEX-Agents14.3%estimated ± 0.6 pp, low confidence
APEX-Agents-AA16.7%estimated ± 4.2 pp, high confidence
DeepSearchQA79.9%estimated ± 7.3 pp, low confidence
AutomationBench22.2%estimated ± 10.5 pp, low confidence
BFCL v466.9%estimated ± 2.9 pp, medium confidence
CyberGym57.9%estimated ± 7.3 pp, medium confidence
JobBench29.2%estimated ± 6.4 pp, medium confidence
τ³-bench results17.0%measured
WideResearch72.7%estimated ± 3.5 pp, high confidence
AA Agentic Index4.9%estimated ± 5.9 pp, medium confidence
MMLU-Pro85.1%estimated ± 2.5 pp, medium confidence
Artificial Analysis Intelligence Index17.0%estimated ± 6.1 pp, medium confidence
GPQA88.7%estimated ± 1.2 pp, high confidence
MMLU87.3%estimated ± 1.0 pp, high confidence
AA-Omniscience Accuracy21.8%measured
MMMLU89.4%estimated ± 1.1 pp, medium confidence
AA MMLU-Pro84.3%estimated ± 0.7 pp, medium confidence
Gert Labs49.9%estimated ± 7.4 pp, medium confidence
AA EnterpriseOps-Gym36.4%estimated ± 3.3 pp, low confidence
AA Harvey LAB v1.088.0%estimated ± 9.8 pp, low confidence
AA Tau3 Banking28.5%estimated ± 3.9 pp, medium confidence
AA Terminal-Bench 2.162.6%estimated ± 6.8 pp, low confidence
ARC-AGI-187.2%estimated ± 2.7 pp, high confidence
ARC-AGI-251.2%estimated ± 10.1 pp, low confidence
Terminal-Bench 3.04.2%estimated ± 9.1 pp, low confidence
MazeBench0.0%estimated ± 6.1 pp, low confidence
OSWorld-Verified62.9%estimated ± 5.8 pp, medium confidence
Vals GPQA Diamond88.0%estimated ± 2.0 pp, high confidence
Vals MMLU-Pro86.0%estimated ± 1.6 pp, high confidence
Terminal-Bench 2.1 (Vals AI)47.6%estimated ± 7.4 pp, low confidence
CWE-Bench-AA37.3%estimated ± 5.8 pp, medium confidence
AA Cyber Index34.4%estimated ± 13.3 pp, low confidence
DeepsecBench-AA4.0%estimated ± 9.1 pp, medium confidence
GDP.pdf7.5%estimated ± 4.9 pp, low confidence
AA ITBench41.2%estimated ± 4.1 pp, high confidence
AA Terminal-Bench 4.01.9%estimated ± 11.6 pp, low confidence
HLE w/o tools28.7%measured
Toolathlon-Verified54.6%estimated ± 7.7 pp, medium confidence
ARC-AGI-30.0%estimated ± 3.6 pp, high confidence
Claw-Eval64.3%estimated ± 6.3 pp, low confidence
DeepPlanning37.7%estimated ± 13.1 pp, low confidence
MCP Atlas55.6%measured
MCP-Tasks76.0%estimated ± 0.6 pp, low confidence
MMLU-Redux93.7%estimated ± 0.8 pp, medium confidence
QwenClawBench54.8%estimated ± 2.6 pp, high confidence
SuperGPQA65.0%estimated ± 9.3 pp, medium confidence
Toolathlon40.0%estimated ± 4.2 pp, high confidence
MedXpertQA (Text)50.5%estimated ± 4.5 pp, medium confidence
MMLU-Pro (Arcee)86.5%estimated ± 3.4 pp, medium confidence
ResearchClawBench16.8%estimated ± 1.8 pp, medium confidence
DRACO64.0%estimated ± 4.5 pp, low confidence
HealthBench Professional47.9%estimated ± 4.8 pp, low confidence
HLE-Verified17.0%estimated ± 7.1 pp, low confidence
STEMBench2.4%estimated ± 0.2 pp, low confidence
SimpleQA20.6%estimated ± 4.3 pp, medium confidence
Agents' Last Exam18.1%estimated ± 13.0 pp, low confidence
MRCRv260.4%estimated ± 11.3 pp, low confidence
MMLongBench-Doc60.8%estimated ± 2.6 pp, low confidence
PinchBench90.4%measured