benchgap
NVIDIA · model

Nemotron Ultra 253B benchmark scores

As of 2026-11-22, Nemotron Ultra 253B (NVIDIA) has measured scores on 10 benchmarks and estimated scores on 33 more.

BenchmarkScoreSource
AA-GPQA Diamond72.8%measured
AA-HLE7.4%measured
AIME2673.4%estimated ± 4.3 pp, medium confidence
Artificial Analysis Intelligence Index12.6%estimated ± 7.2 pp, medium confidence
CritPt0.0%measured
GDPval-AA0.0%estimated ± 11.0 pp, low confidence
GPQA Diamond76.2%estimated ± 1.2 pp, high confidence
HLE13.1%estimated ± 6.5 pp, medium confidence
IFBench54.0%estimated ± 6.6 pp, low confidence
AA-Omniscience Accuracy20.3%estimated ± 7.7 pp, medium confidence
BrowseComp16.1%estimated ± 13.0 pp, low confidence
IFEval89.5%measured
τ²-bench results11.4%measured
BioMysteryBench (human-difficult)0.0%estimated ± 6.8 pp, low confidence
SWE-bench Verified60.5%estimated ± 9.3 pp, low confidence
AA Agentic Index0.0%estimated ± 12.7 pp, low confidence
MMLU-Pro82.5%estimated ± 4.4 pp, high confidence
AA-IFBench38.2%measured
AIME 202481.7%estimated ± 2.6 pp, high confidence
GPQA76.0%measured
MMLU88.0%estimated ± 4.2 pp, high confidence
Vals GPQA Diamond71.9%estimated ± 3.2 pp, high confidence
Vals MMLU-Pro81.5%estimated ± 2.3 pp, high confidence
MATH-50097.0%measured
MMMLU83.3%estimated ± 0.7 pp, medium confidence
AIME 202572.5%measured
AA MMLU-Pro85.7%estimated ± 1.2 pp, low confidence
ARC-AGI-138.8%estimated ± 6.7 pp, low confidence
ARC-AGI-20.0%estimated ± 10.9 pp, low confidence
HLE w/o tools12.2%estimated ± 5.3 pp, medium confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
C-Eval90.8%estimated ± 1.1 pp, low confidence
HMMT Feb 202564.0%estimated ± 2.9 pp, medium confidence
HMMT Feb 202637.6%estimated ± 11.0 pp, low confidence
MMLU-Redux91.9%estimated ± 1.7 pp, high confidence
SuperGPQA56.1%estimated ± 8.5 pp, low confidence
HealthBench Hard0.0%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
SimpleQA25.0%estimated ± 7.8 pp, medium confidence
LiveCodeBench66.3%measured
BioBasicsBench33.9%estimated ± 10.7 pp, low confidence