benchgap
OpenAI · model

GPT-5.4 benchmark scores

As of 2026-10-07, GPT-5.4 (OpenAI) has measured scores on 51 benchmarks and estimated scores on 73 more.

BenchmarkScoreSource
AA-GPQA Diamond92.0%measured
AA-HLE43.7%measured
AA-SciCode54.3%estimated ± 3.2 pp, high confidence
AIME26100.0%estimated ± 0.6 pp, low confidence
Artificial Analysis Intelligence Index39.0%measured
CritPt23.4%measured
GDPval-AA37.4%measured
GPQA Diamond92.8%measured
HLE52.1%measured
IFBench72.4%estimated ± 6.9 pp, medium confidence
AA-LCR82.0%measured
LiveCodeBench v688.6%estimated ± 2.1 pp, high confidence
AA-Omniscience Accuracy50.8%measured
SciCode54.0%estimated ± 4.7 pp, medium confidence
BrowseComp82.7%measured
HLE w/ tools56.6%estimated ± 4.6 pp, high confidence
IFEval93.6%estimated ± 1.3 pp, high confidence
LongBench v261.5%estimated ± 5.9 pp, low confidence
VITA-Bench44.3%estimated ± 9.9 pp, low confidence
τ²-bench results98.9%measured
AA Coding Index71.1%measured
AA-MMMU-Pro78.4%measured
APEX-Agents26.3%estimated ± 0.6 pp, medium confidence
APEX-Agents-AA33.3%measured
BioMysteryBench (human-difficult)45.9%estimated ± 5.9 pp, low confidence
DeepSearchQA73.6%measured
SWE-bench Verified80.7%estimated ± 2.5 pp, high confidence
AutomationBench28.4%estimated ± 5.8 pp, medium confidence
BFCL v476.2%estimated ± 2.6 pp, medium confidence
CyberGym79.0%measured
JobBench38.9%measured
SWE-bench Pro57.7%measured
τ³-bench results69.6%estimated ± 1.8 pp, medium confidence
WideResearch78.8%estimated ± 1.2 pp, medium confidence
AA Agentic Index33.2%estimated ± 1.7 pp, high confidence
MMLU-Pro85.6%estimated ± 2.5 pp, medium confidence
FrontierMath v2 (Tier 4)27.1%measured
FrontierMath v2 (Tiers 1-3)47.6%measured
GPQA92.8%measured
AA-IFBench73.9%measured
Gert Labs64.9%measured
AA-AnalystAgent28.1%estimated ± 12.0 pp, low confidence
AA EnterpriseOps-Gym53.5%estimated ± 3.6 pp, low confidence
AA Harvey LAB0.1%estimated ± 2.0 pp, low confidence
ApprenticeBench11.0%measured
ARC-AGI-193.7%measured
ARC-AGI-274.0%measured
CursorBench 3.150.2%estimated ± 4.8 pp, medium confidence
CursorBench 3.254.9%estimated ± 3.6 pp, high confidence
FrontierCode 1.1 Main40.7%estimated ± 2.8 pp, low confidence
FrontierSWE v211.0%estimated ± 9.0 pp, medium confidence
OfficeQA Pro53.2%measured
OSWorld-Verified75.0%measured
Vals GPQA Diamond92.2%estimated ± 1.1 pp, high confidence
Vals LiveCodeBench86.2%estimated ± 3.8 pp, low confidence
Vals MMLU-Pro88.1%estimated ± 1.2 pp, high confidence
Vals SWE-bench82.3%estimated ± 1.4 pp, low confidence
Terminal-Bench 2.1 (Vals AI)66.0%estimated ± 6.3 pp, medium confidence
AA AutomationBench50.4%estimated ± 5.0 pp, medium confidence
GDP.pdf22.4%estimated ± 4.4 pp, low confidence
AA ITBench39.0%estimated ± 3.6 pp, low confidence
AA Tau3 Banking22.0%estimated ± 5.8 pp, medium confidence
CursorBench 4.033.9%estimated ± 1.6 pp, medium confidence
CWE-bench v146.5%estimated ± 6.9 pp, medium confidence
DeepSWE50.0%estimated ± 4.4 pp, medium confidence
HLE w/o tools39.8%measured
OSWorld 2.09.2%estimated ± 3.6 pp, high confidence
PostTrainBench v1.119.0%measured
ProgramBench0.0%estimated ± 4.8 pp, low confidence
Toolathlon-Verified73.2%estimated ± 1.3 pp, low confidence
Vibe Code Bench67.4%measured
CharXiv82.8%measured
CharXiv w/o tools85.7%estimated ± 1.8 pp, medium confidence
ExploitGym6.0%measured
C-Eval93.3%estimated ± 0.8 pp, low confidence
Claw-Eval60.3%measured
DeepPlanning45.5%estimated ± 13.1 pp, low confidence
HMMT Nov 202593.2%estimated ± 2.6 pp, low confidence
MathVision89.2%estimated ± 1.4 pp, low confidence
MCP Atlas70.6%measured
MCP-Tasks76.9%estimated ± 0.6 pp, low confidence
MMAnswerBench88.0%estimated ± 1.3 pp, low confidence
MMLU-Redux97.4%estimated ± 1.1 pp, low confidence
MMMU-Pro81.2%measured
NL2Repo52.5%estimated ± 5.1 pp, medium confidence
QwenClawBench59.8%estimated ± 2.6 pp, high confidence
ScreenSpot Pro85.4%measured
SuperGPQA86.0%estimated ± 7.5 pp, low confidence
Terminal-Bench 2.075.1%measured
Toolathlon54.6%measured
VideoMMMU87.8%estimated ± 1.0 pp, high confidence
ERQA65.4%measured
HealthBench Hard40.1%measured
LiveCodeBench Pro87.5%measured
MedXpertQA (MM)77.1%measured
MedXpertQA (Text)59.6%measured
MMLU-Pro (Arcee)87.8%estimated ± 3.4 pp, low confidence
React Native Evals85.3%measured
ResearchClawBench15.3%measured
SWE-Rebench62.2%estimated ± 6.5 pp, low confidence
ARC-AGI-30.2%measured
FrontierMath (legacy)48.1%estimated ± 0.7 pp, low confidence
BioMysteryBench (human-solvable)89.4%estimated ± 0.6 pp, medium confidence
DRACO76.9%estimated ± 3.0 pp, medium confidence
FrontierCode 1.1 Extended55.2%estimated ± 3.0 pp, low confidence
HealthBench (raw)52.4%estimated ± 6.4 pp, low confidence
HealthBench (length-adjusted)53.8%estimated ± 0.9 pp, medium confidence
HealthBench Professional48.1%measured
HealthBench Professional (raw)62.6%estimated ± 5.0 pp, medium confidence
HLE-Verified35.3%estimated ± 0.7 pp, low confidence
LABBench278.0%estimated ± 1.3 pp, low confidence
MMMU85.9%estimated ± 0.9 pp, medium confidence
LiveCodeBench100.0%estimated ± 8.9 pp, low confidence
Agents' Last Exam24.0%estimated ± 2.1 pp, high confidence
OpenHarmony Bench56.9%estimated ± 2.8 pp, high confidence
SimpleVQA61.1%measured
ZeroBench41.0%measured
MMMLU90.7%estimated ± 1.1 pp, low confidence
MMLU95.0%estimated ± 1.1 pp, low confidence
MMMU-Pro w/ Python82.1%measured
MathVision w/ Python76.8%estimated ± 0.9 pp, low confidence
RealWorldQA85.7%estimated ± 1.1 pp, medium confidence
Video-MME (with subtitle)88.0%estimated ± 0.9 pp, medium confidence
OmniDocBench 1.591.7%estimated ± 5.9 pp, low confidence