benchgap
DeepSeek · model

DeepSeek-R1 benchmark scores

As of 2026-10-07, DeepSeek-R1 (DeepSeek) has measured scores on 8 benchmarks and estimated scores on 34 more.

BenchmarkScoreSource
AA-GPQA Diamond81.3%measured
AA-HLE15.8%measured
Artificial Analysis Intelligence Index13.1%measured
CritPt1.4%measured
GDPval-AA0.2%estimated ± 12.5 pp, low confidence
GPQA Diamond78.5%estimated ± 2.2 pp, high confidence
HLE29.0%estimated ± 9.5 pp, medium confidence
IFBench55.8%estimated ± 6.9 pp, low confidence
AA-LCR55.7%measured
AA-Omniscience Accuracy30.5%measured
IFEval88.4%estimated ± 1.3 pp, high confidence
LongBench v20.2%estimated ± 5.9 pp, low confidence
τ²-bench results36.5%measured
APEX-Agents-AA1.6%estimated ± 11.4 pp, low confidence
BioMysteryBench (human-difficult)35.3%estimated ± 5.9 pp, low confidence
BFCL v445.0%estimated ± 9.8 pp, low confidence
AA Agentic Index3.0%estimated ± 12.3 pp, low confidence
MMLU-Pro85.7%estimated ± 3.5 pp, high confidence
GPQA74.2%estimated ± 3.2 pp, high confidence
AA-IFBench39.6%measured
AA EnterpriseOps-Gym1.4%estimated ± 3.6 pp, low confidence
ARC-AGI-19.7%estimated ± 5.4 pp, low confidence
ARC-AGI-23.1%estimated ± 14.2 pp, low confidence
Vals GPQA Diamond74.2%estimated ± 7.4 pp, medium confidence
Vals MMLU-Pro85.1%estimated ± 2.2 pp, high confidence
AA ITBench99.0%estimated ± 3.6 pp, low confidence
HLE w/o tools13.2%estimated ± 5.7 pp, medium confidence
C-Eval87.0%estimated ± 1.0 pp, low confidence
MCP-Tasks100.0%estimated ± 8.2 pp, low confidence
MMLU-Redux95.6%estimated ± 1.1 pp, medium confidence
SuperGPQA75.0%estimated ± 7.5 pp, medium confidence
HealthBench Hard0.7%estimated ± 7.7 pp, low confidence
MMLU-Pro (Arcee)82.4%estimated ± 4.0 pp, medium confidence
ARC-AGI-31.7%estimated ± 3.4 pp, medium confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
HealthBench (raw)22.8%estimated ± 6.4 pp, low confidence
HealthBench (length-adjusted)53.9%estimated ± 3.7 pp, low confidence
HealthBench Professional57.7%estimated ± 4.8 pp, low confidence
HealthBench Professional (raw)35.3%estimated ± 5.0 pp, low confidence
HLE-Verified15.3%estimated ± 2.0 pp, low confidence
LABBench264.5%estimated ± 1.8 pp, low confidence
MMLU91.0%estimated ± 1.1 pp, medium confidence