benchgap
Anthropic · model

Claude 4.1 Opus benchmark scores

As of 2026-10-07, Claude 4.1 Opus (Anthropic) has measured scores on 3 benchmarks and estimated scores on 52 more.

BenchmarkScoreSource
AA-GPQA Diamond82.4%estimated ± 6.8 pp, medium confidence
AA-HLE18.7%estimated ± 4.4 pp, high confidence
AA-SciCode45.7%estimated ± 3.9 pp, high confidence
Artificial Analysis Intelligence Index18.6%measured
CritPt1.7%estimated ± 3.7 pp, high confidence
GDPval-AA29.0%estimated ± 6.2 pp, medium confidence
GPQA Diamond83.0%estimated ± 2.4 pp, high confidence
HLE20.3%estimated ± 9.9 pp, medium confidence
LiveCodeBench v685.4%estimated ± 8.1 pp, low confidence
AA-Omniscience Accuracy24.8%estimated ± 7.5 pp, medium confidence
SciCode45.9%estimated ± 3.8 pp, high confidence
BrowseComp68.4%estimated ± 6.2 pp, medium confidence
AA Coding Index49.4%estimated ± 5.1 pp, medium confidence
APEX-Agents-AA24.6%estimated ± 3.6 pp, medium confidence
BioMysteryBench (human-difficult)35.2%estimated ± 8.1 pp, low confidence
DeepSearchQA76.9%estimated ± 10.9 pp, low confidence
SWE-bench Verified74.5%measured
CyberGym47.6%estimated ± 11.4 pp, low confidence
JobBench21.9%measured
SWE-bench Pro50.1%estimated ± 3.2 pp, high confidence
WideResearch75.1%estimated ± 1.2 pp, medium confidence
MMLU-Pro84.8%estimated ± 4.5 pp, high confidence
GPQA83.8%estimated ± 3.2 pp, high confidence
Gert Labs50.8%estimated ± 7.3 pp, medium confidence
ApprenticeBench0.5%estimated ± 5.6 pp, low confidence
ARC-AGI-140.2%estimated ± 5.4 pp, low confidence
ARC-AGI-212.7%estimated ± 14.2 pp, low confidence
FrontierCode 1.1 Main9.7%estimated ± 2.7 pp, low confidence
OSWorld-Verified55.4%estimated ± 8.7 pp, low confidence
Vals GPQA Diamond76.5%estimated ± 7.5 pp, medium confidence
Vals LiveCodeBench75.3%estimated ± 9.9 pp, low confidence
Vals MMLU-Pro82.7%estimated ± 2.6 pp, medium confidence
Vals SWE-bench68.8%estimated ± 6.8 pp, medium confidence
AA AutomationBench45.7%estimated ± 5.0 pp, low confidence
GDP.pdf17.8%estimated ± 5.2 pp, low confidence
HLE w/o tools23.8%estimated ± 6.3 pp, medium confidence
Toolathlon-Verified73.2%estimated ± 1.3 pp, low confidence
Vibe Code Bench2.5%estimated ± 8.1 pp, medium confidence
C-Eval90.5%estimated ± 1.0 pp, medium confidence
Claw-Eval50.7%estimated ± 5.6 pp, low confidence
MCP Atlas44.3%estimated ± 8.2 pp, medium confidence
MMLU-Redux93.7%estimated ± 2.1 pp, medium confidence
NL2Repo36.2%estimated ± 6.1 pp, medium confidence
SuperGPQA64.0%estimated ± 10.4 pp, low confidence
Toolathlon33.1%estimated ± 7.4 pp, low confidence
HealthBench Hard5.2%estimated ± 7.7 pp, low confidence
MMLU-Pro (Arcee)82.7%estimated ± 5.4 pp, low confidence
SWE-Rebench57.1%estimated ± 3.6 pp, medium confidence
BioMysteryBench (human-solvable)27.9%estimated ± 1.0 pp, low confidence
HealthBench (raw)26.9%estimated ± 6.7 pp, low confidence
HealthBench (length-adjusted)53.9%estimated ± 3.7 pp, low confidence
HealthBench Professional (raw)36.8%estimated ± 5.0 pp, low confidence
LiveCodeBench83.0%estimated ± 10.2 pp, low confidence
Agents' Last Exam48.9%estimated ± 8.7 pp, low confidence
MMLU94.2%estimated ± 1.9 pp, low confidence