benchgap
OpenAI · model

GPT-6 Astra benchmark scores

As of 2026-10-07, GPT-6 Astra (OpenAI) has measured scores on 48 benchmarks and estimated scores on 75 more.

BenchmarkScoreSource
AA-GPQA Diamond96.1%measured
AA-HLE54.7%measured
AA-SciCode56.5%measured
AIME26100.0%estimated ± 0.6 pp, low confidence
Artificial Analysis Intelligence Index52.7%measured
CritPt31.7%measured
GDPval-AA52.1%measured
GPQA Diamond96.0%measured
HLE60.9%estimated ± 5.5 pp, low confidence
AA-LCR80.7%measured
LiveCodeBench v693.6%estimated ± 3.1 pp, medium confidence
AA-Omniscience Accuracy62.6%measured
SciCode56.0%estimated ± 3.2 pp, high confidence
Terminal-Bench 2.189.7%estimated ± 3.9 pp, medium confidence
BrowseComp91.5%measured
HLE w/ tools57.2%measured
LongBench v261.5%estimated ± 5.9 pp, low confidence
VITA-Bench46.5%estimated ± 9.9 pp, low confidence
τ²-bench results85.6%estimated ± 4.8 pp, medium confidence
AA Coding Index76.9%measured
AA-MMMU-Pro86.9%measured
APEX-Agents42.5%estimated ± 10.0 pp, low confidence
APEX-Agents-AA38.9%estimated ± 2.9 pp, low confidence
BioMysteryBench (human-difficult)50.2%estimated ± 5.9 pp, low confidence
DeepSearchQA93.6%estimated ± 4.5 pp, high confidence
SWE-bench Verified95.3%estimated ± 0.8 pp, medium confidence
AutomationBench41.4%measured
BFCL v477.6%estimated ± 2.6 pp, medium confidence
CyberGym79.9%estimated ± 2.4 pp, medium confidence
JobBench66.0%estimated ± 4.9 pp, low confidence
SWE-bench Pro86.7%estimated ± 5.1 pp, low confidence
WideResearch82.7%estimated ± 3.4 pp, low confidence
AA Agentic Index51.5%measured
MMLU-Pro87.6%estimated ± 3.0 pp, medium confidence
FrontierMath v2 (Tier 4)97.6%measured
FrontierMath v2 (Tiers 1-3)93.1%estimated ± 7.4 pp, low confidence
GPQA96.0%measured
Gert Labs100.0%estimated ± 3.0 pp, low confidence
AA-AnalystAgent51.2%measured
AA EnterpriseOps-Gym53.0%estimated ± 1.8 pp, low confidence
AA Harvey LAB93.5%estimated ± 1.2 pp, medium confidence
ApprenticeBench68.0%measured
ARC-AGI-198.5%measured
ARC-AGI-295.0%measured
CursorBench 3.160.0%estimated ± 3.4 pp, medium confidence
CursorBench 3.269.5%estimated ± 1.6 pp, medium confidence
Terminal-Bench 3.038.5%estimated ± 6.9 pp, low confidence
FrontierCode 1.1 Main53.3%measured
FrontierSWE v265.5%measured
OfficeQA Pro67.7%estimated ± 7.2 pp, medium confidence
OSWorld-Verified99.7%estimated ± 1.9 pp, low confidence
Vals GPQA Diamond96.1%estimated ± 1.1 pp, high confidence
Vals LiveCodeBench89.0%estimated ± 1.9 pp, high confidence
Vals MMLU-Pro88.9%estimated ± 1.2 pp, medium confidence
Vals SWE-bench97.1%estimated ± 1.4 pp, low confidence
Terminal-Bench 2.1 (Vals AI)87.3%measured
VulcanBench v387.1%estimated ± 0.7 pp, low confidence
AA AutomationBench68.5%measured
GDP.pdf31.0%measured
AA ITBench48.6%measured
AA Tau3 Banking41.4%measured
AA Terminal-Bench 2.188.4%measured
AA Terminal-Bench 4.059.1%measured
CursorBench 4.042.5%estimated ± 1.6 pp, high confidence
CWE-bench v168.0%measured
DeepSWE74.1%measured
HLE w/o tools48.5%estimated ± 4.4 pp, medium confidence
OSWorld 2.072.6%measured
PostTrainBench v1.144.3%measured
ProgramBench90.9%estimated ± 4.8 pp, medium confidence
Terminal-Bench 4.057.9%measured
Terminal-Bench-Science 0.164.6%measured
Toolathlon-Verified80.0%estimated ± 1.0 pp, low confidence
Vibe Code Bench80.8%estimated ± 5.6 pp, low confidence
CharXiv88.5%estimated ± 3.9 pp, medium confidence
CharXiv w/o tools86.7%estimated ± 2.4 pp, medium confidence
ExploitBench100.0%measured
ExploitGym42.4%measured
C-Eval96.4%estimated ± 0.9 pp, low confidence
Claw-Eval81.7%estimated ± 7.9 pp, low confidence
HMMT Nov 202593.2%estimated ± 2.6 pp, low confidence
MathVision96.2%estimated ± 2.4 pp, low confidence
MCP Atlas87.3%estimated ± 2.7 pp, low confidence
MMAnswerBench100.0%estimated ± 1.3 pp, low confidence
MMLU-Redux97.9%estimated ± 1.1 pp, low confidence
MMMU-Pro81.9%estimated ± 2.7 pp, medium confidence
NL2Repo57.1%estimated ± 5.1 pp, low confidence
QwenClawBench100.0%estimated ± 6.0 pp, low confidence
ScreenSpot Pro92.7%measured
SuperGPQA89.7%estimated ± 7.5 pp, low confidence
Terminal-Bench 2.084.0%estimated ± 5.9 pp, low confidence
Toolathlon66.4%estimated ± 1.7 pp, low confidence
VideoMMMU90.6%estimated ± 1.7 pp, low confidence
ERQA68.9%estimated ± 3.9 pp, medium confidence
HealthBench Hard36.6%measured
MedXpertQA (MM)77.8%estimated ± 6.5 pp, low confidence
MedXpertQA (Text)77.7%estimated ± 4.5 pp, low confidence
MMLU-Pro (Arcee)88.8%estimated ± 3.4 pp, low confidence
React Native Evals83.4%estimated ± 3.5 pp, medium confidence
ResearchClawBench21.1%estimated ± 2.0 pp, medium confidence
SWE-Rebench58.1%estimated ± 8.9 pp, low confidence
ARC-AGI-362.7%measured
FrontierMath (legacy)90.7%estimated ± 2.3 pp, low confidence
BioMysteryBench (human-solvable)89.5%estimated ± 0.6 pp, medium confidence
DRACO82.9%estimated ± 3.0 pp, medium confidence
FrontierCode 1.1 Extended64.5%measured
HealthBench (raw)56.9%measured
HealthBench (length-adjusted)58.3%measured
HealthBench Professional64.7%measured
HealthBench Professional (raw)68.2%measured
HLE-Verified54.6%estimated ± 0.7 pp, low confidence
LABBench285.6%estimated ± 1.3 pp, medium confidence
MMMU93.3%estimated ± 0.9 pp, medium confidence
LiveCodeBench100.0%estimated ± 8.9 pp, low confidence
Agents' Last Exam59.3%measured
OpenHarmony Bench58.8%estimated ± 2.4 pp, high confidence
SEC-Bench Pro85.4%measured
SimpleVQA58.1%estimated ± 5.7 pp, low confidence
MMMLU91.6%estimated ± 1.1 pp, low confidence
MMLU96.3%estimated ± 1.1 pp, low confidence
MMMU-Pro w/ Python85.8%estimated ± 1.6 pp, medium confidence
RealWorldQA91.0%estimated ± 1.2 pp, low confidence
OmniDocBench 1.592.0%estimated ± 6.4 pp, low confidence