benchgap
OpenAI · model

GPT-4.1 nano benchmark scores

As of 2026-10-07, GPT-4.1 nano (OpenAI) has measured scores on 15 benchmarks and estimated scores on 87 more.

BenchmarkScoreSource
AA-GPQA Diamond51.2%measured
AA-HLE3.8%measured
AA-SciCode27.5%estimated ± 3.2 pp, high confidence
AIME2695.4%estimated ± 0.6 pp, low confidence
Artificial Analysis Intelligence Index7.8%measured
CritPt0.0%measured
GDPval-AA0.0%measured
GPQA Diamond50.3%estimated ± 0.4 pp, high confidence
HLE5.5%estimated ± 8.2 pp, low confidence
IFBench55.4%estimated ± 6.9 pp, low confidence
AA-LCR20.3%measured
LiveCodeBench v662.6%estimated ± 3.1 pp, high confidence
AA-Omniscience Accuracy13.7%measured
SciCode28.0%estimated ± 4.7 pp, medium confidence
BrowseComp0.0%estimated ± 10.1 pp, low confidence
HLE w/ tools31.6%estimated ± 6.1 pp, low confidence
IFEval83.2%measured
LongBench v20.0%estimated ± 5.9 pp, low confidence
τ²-bench results17.3%measured
AA Coding Index11.1%measured
AA-MMMU-Pro40.1%measured
APEX-Agents0.0%estimated ± 10.0 pp, low confidence
APEX-Agents-AA4.7%estimated ± 9.1 pp, medium confidence
BioMysteryBench (human-difficult)20.6%estimated ± 5.9 pp, low confidence
DeepSearchQA34.5%estimated ± 8.4 pp, medium confidence
SWE-bench Verified13.3%estimated ± 5.5 pp, low confidence
AutomationBench28.4%estimated ± 9.7 pp, low confidence
BFCL v453.8%estimated ± 2.6 pp, high confidence
CyberGym0.0%estimated ± 6.2 pp, low confidence
JobBench0.0%estimated ± 8.6 pp, low confidence
SWE-bench Pro16.4%estimated ± 6.0 pp, low confidence
WideResearch41.6%estimated ± 9.1 pp, low confidence
AA Agentic Index2.7%estimated ± 2.8 pp, high confidence
MMLU-Pro62.7%estimated ± 3.0 pp, high confidence
FrontierMath v2 (Tier 4)1.2%estimated ± 4.5 pp, medium confidence
FrontierMath v2 (Tiers 1-3)1.0%measured
GPQA50.3%measured
AA-IFBench32.0%measured
Gert Labs36.0%estimated ± 8.9 pp, medium confidence
AA-AnalystAgent0.0%estimated ± 12.0 pp, low confidence
AA EnterpriseOps-Gym1.2%estimated ± 3.6 pp, low confidence
ARC-AGI-10.7%estimated ± 5.4 pp, low confidence
ARC-AGI-20.0%estimated ± 11.6 pp, low confidence
CursorBench 3.147.9%estimated ± 4.8 pp, low confidence
CursorBench 3.26.0%estimated ± 4.4 pp, medium confidence
FrontierCode 1.1 Main3.1%estimated ± 3.8 pp, medium confidence
FrontierSWE v20.0%estimated ± 14.8 pp, low confidence
OfficeQA Pro50.3%estimated ± 7.2 pp, low confidence
OSWorld-Verified55.6%estimated ± 8.7 pp, low confidence
Vals GPQA Diamond32.1%estimated ± 4.8 pp, medium confidence
Vals MMLU-Pro0.4%estimated ± 1.2 pp, medium confidence
Vals SWE-bench41.6%estimated ± 5.4 pp, low confidence
AA AutomationBench3.7%estimated ± 7.0 pp, low confidence
GDP.pdf9.4%estimated ± 5.4 pp, low confidence
AA ITBench100.0%estimated ± 3.6 pp, low confidence
AA Tau3 Banking22.0%estimated ± 5.8 pp, low confidence
CursorBench 4.02.2%estimated ± 1.6 pp, medium confidence
CWE-bench v10.0%estimated ± 6.9 pp, low confidence
DeepSWE0.0%estimated ± 6.4 pp, low confidence
HLE w/o tools6.0%estimated ± 4.9 pp, medium confidence
PostTrainBench v1.18.3%estimated ± 6.1 pp, low confidence
Toolathlon-Verified0.0%estimated ± 2.4 pp, medium confidence
Vibe Code Bench2.8%estimated ± 10.3 pp, low confidence
CharXiv70.3%estimated ± 7.5 pp, low confidence
CharXiv w/o tools52.2%estimated ± 2.4 pp, medium confidence
C-Eval65.5%estimated ± 0.9 pp, low confidence
MathVision81.5%estimated ± 4.9 pp, medium confidence
MCP Atlas50.2%estimated ± 11.1 pp, low confidence
MCP-Tasks100.0%estimated ± 8.2 pp, low confidence
MMAnswerBench82.8%estimated ± 1.5 pp, low confidence
MMLU-Redux90.3%estimated ± 1.1 pp, medium confidence
MMMU-Pro59.2%estimated ± 4.4 pp, low confidence
NL2Repo5.8%estimated ± 5.1 pp, low confidence
QwenClawBench55.9%estimated ± 6.0 pp, low confidence
ScreenSpot Pro56.2%estimated ± 10.7 pp, low confidence
SuperGPQA53.8%estimated ± 7.5 pp, medium confidence
Toolathlon26.9%estimated ± 6.3 pp, low confidence
ERQA0.0%estimated ± 3.9 pp, medium confidence
HealthBench Hard0.0%estimated ± 5.1 pp, low confidence
MedXpertQA (MM)0.0%estimated ± 6.5 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
React Native Evals66.9%estimated ± 3.5 pp, medium confidence
ResearchClawBench0.0%estimated ± 2.2 pp, low confidence
SWE-Rebench0.0%estimated ± 8.9 pp, low confidence
ARC-AGI-30.0%estimated ± 2.1 pp, medium confidence
FrontierMath (legacy)2.2%estimated ± 0.7 pp, low confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
DRACO61.5%estimated ± 3.0 pp, low confidence
FrontierCode 1.1 Extended11.8%estimated ± 3.4 pp, low confidence
HealthBench (raw)6.0%estimated ± 6.4 pp, low confidence
HealthBench (length-adjusted)53.9%estimated ± 3.7 pp, low confidence
HealthBench Professional2.6%estimated ± 4.8 pp, low confidence
HealthBench Professional (raw)20.4%estimated ± 5.0 pp, low confidence
HLE-Verified15.3%estimated ± 2.0 pp, low confidence
LABBench232.4%estimated ± 1.8 pp, low confidence
MMMU68.8%estimated ± 0.9 pp, medium confidence
LiveCodeBench16.6%estimated ± 8.9 pp, low confidence
OpenHarmony Bench30.0%estimated ± 2.8 pp, medium confidence
MMLU80.1%measured
MMMU-Pro w/ Python51.5%estimated ± 1.6 pp, medium confidence
RealWorldQA59.7%estimated ± 1.2 pp, low confidence
OmniDocBench 1.50.0%estimated ± 6.4 pp, low confidence