benchgap
Anthropic · model

Claude Fable 5.1 benchmark scores

As of 2026-11-21, Claude Fable 5.1 (Anthropic) has measured scores on 72 benchmarks and estimated scores on 101 more.

BenchmarkScoreSource
AA-GPQA Diamond93.7%measured
AA-HLE59.1%measured
AA-SciCode63.1%measured
AIME2698.1%estimated ± 1.4 pp, medium confidence
Artificial Analysis Intelligence Index49.2%measured
CritPt29.7%measured
GDPval-AA62.7%measured
GPQA Diamond95.5%estimated ± 1.4 pp, high confidence
HLE65.0%measured
AA-LCR85.3%measured
LiveCodeBench v691.1%estimated ± 2.2 pp, low confidence
AA-Omniscience Accuracy68.4%measured
SciCode57.8%estimated ± 2.9 pp, low confidence
Terminal-Bench 2.188.8%estimated ± 5.6 pp, low confidence
BrowseComp83.0%estimated ± 1.9 pp, high confidence
HLE w/ tools65.3%estimated ± 4.9 pp, medium confidence
LongBench v270.6%estimated ± 5.5 pp, low confidence
AA Coding Index81.6%measured
AA-MMMU-Pro92.1%estimated ± 2.3 pp, medium confidence
APEX-Agents37.5%estimated ± 7.4 pp, low confidence
APEX-Agents-AA38.2%estimated ± 2.9 pp, medium confidence
BioMysteryBench (human-difficult)49.7%estimated ± 6.8 pp, low confidence
DeepSearchQA94.3%estimated ± 4.5 pp, medium confidence
SWE-bench Verified97.8%estimated ± 3.6 pp, medium confidence
AutomationBench31.4%measured
BFCL v477.4%estimated ± 2.7 pp, medium confidence
CyberGym84.1%estimated ± 3.1 pp, low confidence
JobBench61.7%estimated ± 4.9 pp, medium confidence
SWE-bench Pro81.2%measured
WideResearch85.6%estimated ± 3.9 pp, low confidence
AA Agentic Index58.0%measured
MMLU-Pro86.0%estimated ± 2.5 pp, low confidence
FailureSensorIQ68.0%estimated ± 1.7 pp, high confidence
GPQA95.2%estimated ± 1.6 pp, high confidence
MMLU97.9%estimated ± 1.2 pp, medium confidence
Vals GPQA Diamond93.4%measured
Vals LiveCodeBench90.5%measured
Vals MMLU-Pro92.4%measured
MMMLU89.9%estimated ± 1.7 pp, medium confidence
Chess Puzzles48.0%measured
AA MMLU-Pro91.5%estimated ± 0.7 pp, medium confidence
Gert Labs88.0%estimated ± 8.3 pp, low confidence
AA-AnalystAgent57.5%measured
AA EnterpriseOps-Gym34.0%estimated ± 7.2 pp, low confidence
AA Harvey LAB v1.093.0%measured
AA Tau3 Banking47.2%measured
AA Terminal-Bench 2.191.4%measured
ApprenticeBench72.0%measured
ARC-AGI-197.5%measured
ARC-AGI-290.0%measured
BabaIsBench100.0%measured
CursorBench 3.176.3%estimated ± 3.4 pp, low confidence
CursorBench 3.273.4%measured
EBR-bench57.1%measured
Terminal-Bench 3.046.0%estimated ± 3.0 pp, medium confidence
FrontierCode 1.1 Main57.9%estimated ± 1.6 pp, low confidence
FrontierMath v2 (Tier 4)87.8%measured
FrontierMath v2 (Tiers 1-3)90.2%measured
FrontierSWE v256.3%measured
Furniture Assembly70.0%measured
MaxxBench70.2%estimated ± 4.3 pp, medium confidence
MazeBench10.0%measured
MirrorCode93.3%measured
Mystery Game Puzzles58.0%measured
NYT Connections90.0%measured
OfficeQA Pro69.0%measured
OSWorld-Verified88.6%estimated ± 8.4 pp, low confidence
ParseBench-177.8%measured
Terminal-Bench 4.157.6%measured
Terminal-Bench Hard68.4%estimated ± 2.8 pp, low confidence
Vals SWE-bench100.0%estimated ± 3.7 pp, medium confidence
Terminal-Bench 2.1 (Vals AI)85.0%measured
VulcanBench v387.6%estimated ± 3.9 pp, low confidence
CWE-Bench-AA50.8%measured
AA Cyber Index25.0%measured
DeepsecBench-AA23.5%measured
Harvey LAB-AA v1.16.4%measured
HealthBench Professional (length-adjusted, Artificial Analysis)57.8%measured
HealthBench Professional (raw, Artificial Analysis)69.2%measured
AA ITBench49.5%measured
BenchCAD Vision2Code (no tools)0.4%measured
BenchCAD Vision2Code (tools)0.8%measured
Bug Hunt Bench43.0%measured
Chartography (no tools)42.6%measured
Chartography (tools)86.2%measured
CursorBench 4.051.8%measured
CWE-bench v158.0%measured
DeepSWE67.4%measured
DRACO87.7%measured
FrontierCode 2.034.0%measured
FrontierPhysics11.3%measured
HLE w/o tools60.9%measured
OfficeQA80.2%measured
OSWorld 2.041.7%measured
OSWorld 2.180.7%measured
OSWorld 2.1 Offline83.5%measured
PostTrainBench v1.140.2%measured
ProgramBench87.6%measured
SpireClimb2.0%measured
StealthMark62.9%measured
SWE Multilingual89.1%measured
SWE-bench Multimodal54.7%measured
Terminal-Bench 4.055.8%measured
Terminal-Bench-Science 0.152.6%measured
Toolathlon-Verified77.8%measured
VulcanBench Frontier v491.8%measured
AA AutomationBench59.2%estimated ± 5.5 pp, medium confidence
GDP.pdf26.7%estimated ± 2.8 pp, medium confidence
AA Terminal-Bench 4.057.2%estimated ± 6.2 pp, medium confidence
ARC-AGI-330.6%estimated ± 7.2 pp, medium confidence
ARC-AGI-3 Provider Adapter97.3%estimated ± 7.3 pp, medium confidence
cursorBench4152.8%estimated ± 2.0 pp, high confidence
CWE-bench65.0%estimated ± 4.6 pp, high confidence
MKA54.0%estimated ± 3.4 pp, high confidence
SkillsBench official leaderboard (BenchFlow)56.9%estimated ± 6.1 pp, medium confidence
BinaryAudit35.8%estimated ± 12.1 pp, low confidence
OTelBench22.5%estimated ± 6.6 pp, medium confidence
Vibe Code Bench100.0%estimated ± 10.0 pp, low confidence
FACTS Multimodal50.4%estimated ± 4.0 pp, high confidence
Hermes Bench73.2%estimated ± 2.4 pp, low confidence
Hermes Index58.7%estimated ± 3.1 pp, high confidence
ParseBench-280.4%estimated ± 4.3 pp, high confidence
CharXiv91.7%estimated ± 5.1 pp, low confidence
CharXiv w/o tools89.6%estimated ± 1.8 pp, low confidence
ExploitBench99.1%estimated ± 6.5 pp, medium confidence
ExploitGym30.6%estimated ± 2.7 pp, high confidence
C-Eval94.7%estimated ± 1.2 pp, low confidence
HMMT Feb 2026100.0%estimated ± 3.1 pp, medium confidence
HMMT Nov 202596.1%estimated ± 1.5 pp, low confidence
INCLUDE89.0%estimated ± 2.0 pp, medium confidence
MCP Atlas82.5%estimated ± 6.0 pp, low confidence
MMAnswerBench96.8%estimated ± 2.4 pp, low confidence
MMLU-Redux96.4%estimated ± 1.2 pp, low confidence
MMMU-Pro85.8%estimated ± 6.9 pp, low confidence
NL2Repo61.0%estimated ± 4.7 pp, medium confidence
PostTrainBench v145.9%estimated ± 1.8 pp, low confidence
ScreenSpot Pro94.6%estimated ± 10.1 pp, low confidence
SuperGPQA100.0%estimated ± 7.2 pp, low confidence
Terminal-Bench 2.081.9%estimated ± 5.8 pp, low confidence
Toolathlon55.2%estimated ± 5.1 pp, low confidence
HealthBench Hard33.9%estimated ± 8.6 pp, low confidence
LiveCodeBench Pro97.9%estimated ± 6.0 pp, low confidence
React Native Evals84.6%estimated ± 3.2 pp, medium confidence
ResearchClawBench21.7%estimated ± 1.9 pp, medium confidence
PostTrainBench36.9%estimated ± 2.0 pp, high confidence
DAYJOB18.9%estimated ± 2.7 pp, high confidence
DAYJOB Healthcare11.1%estimated ± 4.0 pp, high confidence
Finance Agent v262.2%estimated ± 3.8 pp, medium confidence
BioMysteryBench (human-solvable)89.5%estimated ± 0.6 pp, medium confidence
FrontierCode 1.1 Extended62.5%estimated ± 1.6 pp, low confidence
HealthBench (raw)64.5%estimated ± 6.0 pp, medium confidence
HealthBench (length-adjusted)58.0%estimated ± 2.5 pp, low confidence
HealthBench Professional65.8%estimated ± 4.2 pp, medium confidence
HealthBench Professional (raw)74.3%estimated ± 4.5 pp, high confidence
HLE-Verified54.5%estimated ± 1.3 pp, medium confidence
LABBench284.6%estimated ± 1.7 pp, medium confidence
ScarfBench65.5%estimated ± 3.8 pp, medium confidence
BlenderWorld (text-only)82.6%estimated ± 2.8 pp, medium confidence
Cookie-Bench89.6%estimated ± 1.3 pp, medium confidence
STEMBench2.7%estimated ± 0.2 pp, low confidence
SimpleQA35.5%estimated ± 7.8 pp, low confidence
Agents' Last Exam46.3%estimated ± 11.0 pp, low confidence
OpenHarmony Bench v1.058.9%estimated ± 2.4 pp, medium confidence
OpenHarmony Bench v1.263.8%estimated ± 11.0 pp, low confidence
SEC-Bench Pro75.5%estimated ± 6.9 pp, medium confidence
MRCRv286.0%estimated ± 11.3 pp, low confidence
MMLongBench-Doc61.6%estimated ± 2.6 pp, low confidence
SWE-Marathon58.2%estimated ± 2.1 pp, low confidence
BioBasicsBench68.9%estimated ± 2.8 pp, low confidence
LifeVal84.0%estimated ± 2.3 pp, medium confidence
MMMU-Pro w/ Python85.7%estimated ± 2.7 pp, low confidence
ExploitBench Internal Port1.4%estimated ± 1.4 pp, medium confidence
SWE-Atlas Codebase QnA59.8%estimated ± 4.8 pp, high confidence