benchgap
OpenAI · model

GPT-4.1 nano benchmark scores

As of 2026-11-22, GPT-4.1 nano (OpenAI) has measured scores on 18 benchmarks and estimated scores on 92 more.

BenchmarkScoreSource
AA-GPQA Diamond51.2%measured
AA-HLE3.8%measured
AA-SciCode27.3%estimated ± 3.4 pp, high confidence
Artificial Analysis Intelligence Index7.8%measured
CritPt0.0%measured
GDPval-AA0.0%measured
GPQA Diamond50.7%estimated ± 1.2 pp, high confidence
HLE2.3%estimated ± 6.5 pp, low confidence
IFBench53.7%estimated ± 6.6 pp, low confidence
AA-LCR20.3%measured
LiveCodeBench v658.8%estimated ± 4.7 pp, high confidence
AA-Omniscience Accuracy13.7%measured
SciCode28.1%estimated ± 4.6 pp, medium confidence
BrowseComp0.0%estimated ± 9.2 pp, low confidence
HLE w/ tools33.8%estimated ± 5.3 pp, low confidence
IFEval83.2%measured
LongBench v251.2%estimated ± 5.5 pp, low confidence
τ²-bench results17.3%measured
AA Coding Index11.1%measured
AA-MMMU-Pro40.1%measured
APEX-Agents0.0%estimated ± 9.4 pp, low confidence
APEX-Agents-AA6.0%estimated ± 9.5 pp, medium confidence
BioMysteryBench (human-difficult)0.0%estimated ± 6.8 pp, low confidence
DeepSearchQA34.7%estimated ± 9.6 pp, medium confidence
SWE-bench Verified27.9%estimated ± 6.5 pp, low confidence
BFCL v453.9%estimated ± 2.7 pp, high confidence
CyberGym0.0%estimated ± 6.0 pp, low confidence
JobBench0.0%estimated ± 8.7 pp, low confidence
SWE-bench Pro16.4%estimated ± 6.0 pp, low confidence
WideResearch0.0%estimated ± 7.8 pp, low confidence
AA Agentic Index0.0%estimated ± 3.1 pp, high confidence
MMLU-Pro63.0%estimated ± 4.0 pp, high confidence
AA-IFBench32.0%measured
BBH84.2%estimated ± 2.4 pp, medium confidence
FailureSensorIQ63.2%estimated ± 2.1 pp, medium confidence
GPQA50.3%measured
MMLU80.1%measured
Vals GPQA Diamond50.8%measured
Vals LiveCodeBench42.7%measured
Vals MMLU-Pro63.5%measured
MMMLU83.3%estimated ± 0.7 pp, medium confidence
MMMU55.8%estimated ± 2.7 pp, medium confidence
Chess Puzzles0.0%measured
AA MMLU-Pro83.1%estimated ± 0.8 pp, medium confidence
Gert Labs26.9%estimated ± 10.0 pp, low confidence
AA Tau3 Banking0.0%estimated ± 4.1 pp, medium confidence
ARC-AGI-174.7%estimated ± 7.8 pp, low confidence
ARC-AGI-230.5%estimated ± 14.4 pp, low confidence
EBR-bench0.0%estimated ± 12.7 pp, low confidence
Furniture Assembly23.9%estimated ± 14.1 pp, low confidence
MaxxBench27.8%estimated ± 10.3 pp, low confidence
MazeBench0.4%estimated ± 5.5 pp, low confidence
Mystery Game Puzzles0.0%estimated ± 10.3 pp, low confidence
NYT Connections0.0%estimated ± 12.6 pp, low confidence
OSWorld-Verified55.4%estimated ± 8.4 pp, low confidence
ParseBench-140.8%estimated ± 6.2 pp, low confidence
Vals SWE-bench33.8%estimated ± 5.5 pp, low confidence
VulcanBench v376.2%estimated ± 5.6 pp, low confidence
CWE-Bench-AA0.0%estimated ± 10.1 pp, low confidence
DeepsecBench-AA0.0%estimated ± 8.9 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)2.9%estimated ± 2.5 pp, low confidence
AA ITBench35.7%estimated ± 5.1 pp, low confidence
CWE-bench v10.0%estimated ± 6.4 pp, low confidence
DRACO0.0%estimated ± 2.0 pp, low confidence
FrontierPhysics0.0%estimated ± 6.1 pp, low confidence
HLE w/o tools24.3%estimated ± 4.9 pp, medium confidence
SpireClimb0.0%estimated ± 10.3 pp, low confidence
StealthMark25.7%estimated ± 9.7 pp, low confidence
Toolathlon-Verified0.0%estimated ± 3.1 pp, medium confidence
GDP.pdf17.0%estimated ± 4.6 pp, medium confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
SkillsBench official leaderboard (BenchFlow)0.0%estimated ± 6.2 pp, low confidence
Vibe Code Bench2.7%estimated ± 10.0 pp, low confidence
FACTS Multimodal28.9%estimated ± 5.6 pp, low confidence
Hermes Bench0.0%estimated ± 2.9 pp, medium confidence
Hermes Index0.0%estimated ± 8.7 pp, low confidence
ParseBench-227.0%estimated ± 6.2 pp, low confidence
CharXiv53.3%estimated ± 6.3 pp, low confidence
ExploitBench0.0%estimated ± 13.4 pp, low confidence
AI2D_TEST88.0%estimated ± 2.0 pp, low confidence
C-Eval87.9%estimated ± 1.0 pp, low confidence
MCP Atlas56.5%estimated ± 10.7 pp, low confidence
MMLU-Redux92.7%estimated ± 0.8 pp, low confidence
MMMU-Pro39.9%estimated ± 1.5 pp, medium confidence
NL2Repo4.5%estimated ± 4.7 pp, medium confidence
QwenClawBench55.9%estimated ± 6.0 pp, low confidence
ScreenSpot Pro48.2%estimated ± 10.8 pp, low confidence
SuperGPQA64.4%estimated ± 9.3 pp, low confidence
Toolathlon27.0%estimated ± 6.3 pp, low confidence
Video-MME (w/o subtitle)70.1%estimated ± 1.7 pp, low confidence
HealthBench Hard0.0%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
React Native Evals66.8%estimated ± 3.2 pp, medium confidence
ResearchClawBench11.1%estimated ± 2.2 pp, low confidence
DAYJOB0.4%estimated ± 6.3 pp, low confidence
DAYJOB Healthcare0.1%estimated ± 6.1 pp, low confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
HealthBench (length-adjusted)54.1%estimated ± 3.7 pp, medium confidence
HealthBench Professional56.7%estimated ± 4.2 pp, low confidence
ScarfBench24.4%estimated ± 9.1 pp, low confidence
BlenderWorld (text-only)70.6%estimated ± 4.0 pp, low confidence
Cookie-Bench71.0%estimated ± 2.5 pp, low confidence
STEMBench2.3%estimated ± 0.2 pp, low confidence
SimpleQA9.5%estimated ± 4.3 pp, low confidence
SEC-Bench Pro0.0%estimated ± 12.3 pp, low confidence
MRCRv222.8%estimated ± 11.3 pp, low confidence
MMLongBench-Doc52.8%estimated ± 2.6 pp, low confidence
BioBasicsBench10.0%estimated ± 10.2 pp, low confidence
ExploitBench Internal Port0.0%estimated ± 1.4 pp, low confidence