benchgap
DeepSeek · model

DeepSeek-R1-0528 benchmark scores

As of 2026-10-29, DeepSeek-R1-0528 (DeepSeek) has measured scores on 9 benchmarks and estimated scores on 30 more.

BenchmarkScoreSource
AA-GPQA Diamond80.9%estimated ± 3.0 pp, medium confidence
AA-HLE15.8%estimated ± 5.0 pp, high confidence
AA-SciCode37.3%estimated ± 3.9 pp, high confidence
AIME2687.5%estimated ± 4.6 pp, medium confidence
CritPt2.2%estimated ± 3.4 pp, medium confidence
GPQA Diamond81.1%estimated ± 1.2 pp, high confidence
HLE17.7%measured
SciCode37.1%estimated ± 3.3 pp, high confidence
AA Coding Index26.8%estimated ± 5.3 pp, medium confidence
SWE-bench Verified57.6%measured
SWE-bench Pro33.6%estimated ± 4.6 pp, high confidence
MMLU-Pro85.0%measured
AIME 202491.4%measured
Artificial Analysis Intelligence Index21.9%estimated ± 6.3 pp, low confidence
BBH98.8%estimated ± 2.8 pp, medium confidence
GPQA81.0%measured
MMLU90.6%estimated ± 2.2 pp, medium confidence
AA-Omniscience Accuracy26.5%estimated ± 2.7 pp, medium confidence
MATH-50098.0%estimated ± 1.2 pp, medium confidence
MMMLU86.1%estimated ± 1.4 pp, medium confidence
AA MMLU-Pro86.0%estimated ± 1.0 pp, low confidence
AIME 202587.5%measured
ARC-AGI-151.8%estimated ± 7.0 pp, low confidence
ARC-AGI-20.0%estimated ± 11.6 pp, low confidence
Vals GPQA Diamond72.0%estimated ± 4.8 pp, medium confidence
Vals LiveCodeBench39.4%estimated ± 9.9 pp, low confidence
Vals MMLU-Pro72.7%estimated ± 1.2 pp, medium confidence
Vals SWE-bench45.6%estimated ± 6.8 pp, low confidence
HLE w/o tools14.1%estimated ± 5.2 pp, medium confidence
Vibe Code Bench0.6%estimated ± 8.1 pp, low confidence
C-Eval88.1%estimated ± 0.9 pp, low confidence
HMMT Feb 202584.6%estimated ± 3.1 pp, high confidence
MMLU-Redux93.4%measured
NL2Repo9.6%estimated ± 6.2 pp, low confidence
SuperGPQA66.7%estimated ± 4.1 pp, high confidence
React Native Evals71.4%estimated ± 2.3 pp, low confidence
SWE-Rebench57.0%estimated ± 3.6 pp, low confidence
SimpleQA27.8%measured
LiveCodeBench73.3%measured