benchgap
DeepSeek · model

DeepSeek V3 0324 benchmark scores

As of 2026-11-22, DeepSeek V3 0324 (DeepSeek) has measured scores on 11 benchmarks and estimated scores on 81 more.

BenchmarkScoreSource
AA-GPQA Diamond65.5%measured
AA-HLE4.7%measured
AA-SciCode39.0%measured
Artificial Analysis Intelligence Index9.7%measured
CritPt0.0%measured
GDPval-AA0.0%measured
GPQA Diamond69.2%estimated ± 2.4 pp, medium confidence
HLE16.8%estimated ± 8.5 pp, medium confidence
IFBench54.3%estimated ± 6.6 pp, low confidence
AA-LCR40.7%measured
LiveCodeBench v679.7%estimated ± 4.9 pp, high confidence
AA-Omniscience Accuracy24.3%measured
SciCode39.2%estimated ± 3.1 pp, high confidence
BrowseComp0.0%estimated ± 9.2 pp, low confidence
HLE w/ tools33.8%estimated ± 5.3 pp, low confidence
IFEval89.2%estimated ± 2.8 pp, high confidence
LongBench v251.5%estimated ± 5.5 pp, medium confidence
τ²-bench results47.1%measured
AA Coding Index35.0%estimated ± 6.1 pp, medium confidence
APEX-Agents0.0%estimated ± 9.4 pp, low confidence
APEX-Agents-AA6.0%estimated ± 9.5 pp, medium confidence
BioMysteryBench (human-difficult)0.0%estimated ± 6.8 pp, low confidence
DeepSearchQA34.7%estimated ± 9.6 pp, medium confidence
SWE-bench Verified64.5%estimated ± 6.3 pp, medium confidence
BFCL v453.9%estimated ± 2.7 pp, high confidence
CyberGym0.0%estimated ± 6.0 pp, low confidence
JobBench0.0%estimated ± 8.7 pp, low confidence
SWE-bench Pro42.3%estimated ± 6.3 pp, medium confidence
WideResearch0.0%estimated ± 7.8 pp, low confidence
AA Agentic Index0.0%estimated ± 3.1 pp, high confidence
MMLU-Pro84.9%estimated ± 5.0 pp, medium confidence
AA-IFBench41.0%measured
GPQA68.3%estimated ± 6.1 pp, medium confidence
MMLU90.5%estimated ± 0.9 pp, high confidence
Vals GPQA Diamond64.6%estimated ± 3.2 pp, high confidence
Vals LiveCodeBench75.9%estimated ± 5.7 pp, low confidence
Vals MMLU-Pro82.2%estimated ± 2.9 pp, high confidence
MMMLU83.3%estimated ± 0.7 pp, medium confidence
AA MMLU-Pro84.7%estimated ± 0.8 pp, high confidence
Gert Labs26.9%estimated ± 10.0 pp, low confidence
AA Tau3 Banking0.0%estimated ± 4.1 pp, medium confidence
ARC-AGI-174.7%estimated ± 7.8 pp, low confidence
ARC-AGI-230.5%estimated ± 14.4 pp, low confidence
CursorBench 3.236.1%estimated ± 5.3 pp, low confidence
FrontierCode 1.1 Main0.0%estimated ± 6.6 pp, low confidence
FrontierSWE v24.7%estimated ± 14.2 pp, low confidence
MazeBench0.4%estimated ± 5.5 pp, low confidence
OSWorld-Verified55.4%estimated ± 8.4 pp, low confidence
Vals SWE-bench62.2%estimated ± 8.2 pp, medium confidence
CWE-Bench-AA0.0%estimated ± 10.1 pp, low confidence
DeepsecBench-AA0.0%estimated ± 8.9 pp, low confidence
HealthBench Professional (length-adjusted, Artificial Analysis)48.8%estimated ± 4.3 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)41.1%estimated ± 1.1 pp, low confidence
AA ITBench35.7%estimated ± 5.1 pp, low confidence
Bug Hunt Bench14.0%estimated ± 10.5 pp, low confidence
CursorBench 4.025.7%estimated ± 4.9 pp, medium confidence
CWE-bench v10.0%estimated ± 6.4 pp, low confidence
DeepSWE29.0%estimated ± 7.5 pp, low confidence
DRACO0.0%estimated ± 2.0 pp, low confidence
FrontierCode 2.026.1%estimated ± 9.3 pp, low confidence
HLE w/o tools23.6%estimated ± 4.9 pp, high confidence
PostTrainBench v1.125.3%estimated ± 7.4 pp, low confidence
Toolathlon-Verified0.0%estimated ± 3.1 pp, medium confidence
VulcanBench Frontier v468.6%estimated ± 6.8 pp, low confidence
GDP.pdf17.0%estimated ± 4.6 pp, medium confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
Hermes Bench0.0%estimated ± 2.9 pp, medium confidence
Hermes Index0.0%estimated ± 8.7 pp, low confidence
C-Eval88.5%estimated ± 1.0 pp, medium confidence
MCP Atlas56.5%estimated ± 10.7 pp, low confidence
MMLU-ProX70.5%measured
MMLU-Redux94.0%estimated ± 0.8 pp, medium confidence
NL2Repo30.4%estimated ± 7.4 pp, medium confidence
QwenClawBench55.9%estimated ± 6.0 pp, low confidence
SuperGPQA65.5%estimated ± 9.3 pp, medium confidence
Toolathlon27.0%estimated ± 6.3 pp, low confidence
HealthBench Hard0.0%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
React Native Evals72.0%estimated ± 4.7 pp, medium confidence
ResearchClawBench11.1%estimated ± 2.2 pp, low confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
HealthBench (length-adjusted)54.1%estimated ± 3.7 pp, medium confidence
HealthBench Professional56.7%estimated ± 4.2 pp, low confidence
HLE-Verified19.2%estimated ± 7.1 pp, low confidence
ScarfBench36.7%estimated ± 14.0 pp, low confidence
STEMBench2.4%estimated ± 0.2 pp, low confidence
SimpleQA24.0%estimated ± 4.3 pp, medium confidence
OpenHarmony Bench v1.051.0%estimated ± 2.4 pp, medium confidence
MRCRv222.8%estimated ± 11.3 pp, low confidence
MMLongBench-Doc58.3%estimated ± 2.6 pp, low confidence
BioBasicsBench34.1%estimated ± 3.8 pp, low confidence