benchgap
OpenAI · model

GPT-6 Astra benchmark scores

As of 2026-11-22, GPT-6 Astra (OpenAI) has measured scores on 85 benchmarks and estimated scores on 104 more.

BenchmarkScoreSource
AA-GPQA Diamond96.1%measured
AA-HLE54.7%measured
AA-SciCode56.5%measured
AIME2698.2%estimated ± 1.4 pp, medium confidence
Artificial Analysis Intelligence Index56.9%measured
CritPt31.7%measured
GDPval-AA53.7%measured
GPQA Diamond96.0%measured
HLE72.3%estimated ± 2.2 pp, high confidence
AA-LCR80.7%measured
LiveCodeBench v688.9%estimated ± 4.7 pp, medium confidence
AA-Omniscience Accuracy61.6%measured
SciCode56.2%estimated ± 3.1 pp, high confidence
Terminal-Bench 2.188.9%estimated ± 5.6 pp, low confidence
BrowseComp91.5%measured
HLE w/ tools57.2%measured
LongBench v266.3%estimated ± 5.5 pp, medium confidence
VITA-Bench47.3%estimated ± 6.7 pp, low confidence
τ²-bench results98.1%estimated ± 3.1 pp, high confidence
AA Coding Index76.9%measured
AA-MMMU-Pro86.9%measured
APEX-Agents37.5%estimated ± 7.4 pp, low confidence
APEX-Agents-AA38.9%estimated ± 2.9 pp, low confidence
BioMysteryBench (human-difficult)49.9%estimated ± 6.8 pp, low confidence
DeepSearchQA93.6%estimated ± 4.5 pp, high confidence
SWE-bench Verified93.9%estimated ± 2.2 pp, medium confidence
AutomationBench41.4%measured
BFCL v476.9%estimated ± 2.7 pp, medium confidence
CyberGym84.9%estimated ± 4.6 pp, medium confidence
JobBench66.0%estimated ± 4.9 pp, low confidence
SkillsBench65.1%estimated ± 4.1 pp, medium confidence
SWE-bench Pro87.2%estimated ± 4.3 pp, high confidence
WideResearch82.9%estimated ± 3.5 pp, high confidence
AA Agentic Index51.5%measured
MMLU-Pro85.6%estimated ± 4.4 pp, medium confidence
FailureSensorIQ69.6%measured
GPQA96.0%measured
MMLU88.1%estimated ± 4.2 pp, medium confidence
Vals GPQA Diamond98.8%estimated ± 1.2 pp, low confidence
Vals LiveCodeBench89.0%estimated ± 1.9 pp, high confidence
Vals MMLU-Pro89.8%estimated ± 1.6 pp, medium confidence
MMMLU91.6%estimated ± 1.1 pp, low confidence
MMMU90.4%estimated ± 2.7 pp, medium confidence
Chess Puzzles74.0%measured
AA MMLU-Pro90.5%estimated ± 0.8 pp, medium confidence
Gert Labs92.0%measured
AA-AnalystAgent51.2%measured
AA EnterpriseOps-Gym33.9%estimated ± 7.2 pp, low confidence
AA Harvey LAB v1.093.5%estimated ± 1.2 pp, medium confidence
AA Tau3 Banking100.0%estimated ± 2.4 pp, low confidence
AA Terminal-Bench 2.189.9%estimated ± 2.5 pp, medium confidence
ApprenticeBench68.0%measured
ARC-AGI-197.5%measured
ARC-AGI-295.0%measured
BabaIsBench100.0%measured
CursorBench 3.160.0%estimated ± 3.4 pp, medium confidence
CursorBench 3.269.5%estimated ± 1.6 pp, medium confidence
EBR-bench76.2%measured
Terminal-Bench 3.046.8%estimated ± 3.2 pp, medium confidence
FrontierCode 1.1 Main53.3%measured
FrontierMath v2 (Tier 4)97.6%measured
FrontierMath v2 (Tiers 1-3)93.7%measured
FrontierSWE v265.5%measured
Furniture Assembly80.0%measured
MaxxBench71.9%measured
MazeBench24.0%measured
MirrorCode60.0%measured
Mystery Game Puzzles84.0%measured
NYT Connections98.4%measured
OfficeQA Pro67.6%estimated ± 6.8 pp, medium confidence
OSWorld-Verified86.4%estimated ± 5.7 pp, low confidence
ParseBench-169.8%measured
Terminal-Bench 4.160.3%measured
Terminal-Bench Hard69.2%estimated ± 2.8 pp, low confidence
Vals SWE-bench97.1%estimated ± 1.4 pp, low confidence
Terminal-Bench 2.1 (Vals AI)87.3%measured
VulcanBench v387.1%estimated ± 0.7 pp, low confidence
CWE-Bench-AA63.3%measured
AA Cyber Index33.4%measured
DeepsecBench-AA36.9%measured
Harvey LAB-AA v1.18.6%measured
HealthBench Professional (length-adjusted, Artificial Analysis)66.0%measured
HealthBench Professional (raw, Artificial Analysis)69.7%measured
AA ITBench48.6%measured
BenchCAD Vision2Code (no tools)0.8%estimated ± 0.1 pp, medium confidence
BenchCAD Vision2Code (tools)1.0%measured
Bug Hunt Bench45.0%measured
Chartography (tools)90.1%estimated ± 1.6 pp, medium confidence
CursorBench 4.042.7%estimated ± 2.0 pp, high confidence
CWE-bench v168.0%measured
DeepSWE74.1%measured
DRACO87.9%estimated ± 0.7 pp, low confidence
FrontierCode 2.044.0%measured
FrontierPhysics23.2%measured
HLE w/o tools50.3%estimated ± 4.3 pp, medium confidence
OSWorld 2.072.6%measured
OSWorld 2.175.8%measured
OSWorld 2.1 Offline68.3%estimated ± 1.9 pp, medium confidence
PostTrainBench v1.144.3%measured
ProgramBench90.9%estimated ± 4.8 pp, medium confidence
SpireClimb34.0%measured
StealthMark74.6%measured
SWE-bench Multimodal56.7%estimated ± 5.6 pp, low confidence
Terminal-Bench 4.057.9%measured
Terminal-Bench-Science 0.164.6%measured
Toolathlon-Verified77.8%estimated ± 0.8 pp, medium confidence
VulcanBench Frontier v489.3%measured
AA AutomationBench76.2%estimated ± 4.8 pp, medium confidence
GDP.pdf28.0%estimated ± 2.8 pp, medium confidence
AA Terminal-Bench 4.059.9%estimated ± 6.2 pp, medium confidence
ARC-AGI-362.7%measured
ARC-AGI-3 Provider Adapter98.6%measured
cursorBench4144.8%estimated ± 3.7 pp, high confidence
CWE-bench64.2%measured
MKA50.2%measured
SkillsBench official leaderboard (BenchFlow)60.0%estimated ± 6.1 pp, low confidence
BinaryAudit42.8%estimated ± 8.9 pp, low confidence
OTelBench22.5%estimated ± 6.6 pp, low confidence
Vibe Code Bench80.8%estimated ± 5.6 pp, low confidence
FACTS Multimodal55.2%measured
Hermes Bench73.7%measured
Hermes Index56.3%measured
ParseBench-276.5%estimated ± 3.5 pp, high confidence
CharXiv89.1%estimated ± 3.8 pp, medium confidence
CharXiv w/o tools84.8%estimated ± 1.8 pp, medium confidence
ExploitBench100.0%measured
ExploitGym42.4%measured
AI2D_TEST94.2%estimated ± 2.0 pp, low confidence
C-Eval93.8%estimated ± 1.2 pp, medium confidence
Claw-Eval80.0%estimated ± 6.4 pp, medium confidence
CountBench100.0%estimated ± 2.9 pp, low confidence
DynaMath85.5%estimated ± 3.0 pp, low confidence
ERQA68.8%estimated ± 3.1 pp, medium confidence
HMMT Feb 2026100.0%estimated ± 3.1 pp, medium confidence
HMMT Nov 202596.2%estimated ± 1.5 pp, low confidence
MathVision95.5%estimated ± 3.1 pp, medium confidence
MCP Atlas81.5%estimated ± 6.8 pp, medium confidence
MLVU (M-Avg)91.7%estimated ± 7.6 pp, low confidence
MMAnswerBench97.7%estimated ± 2.4 pp, low confidence
MMLU-Redux98.6%estimated ± 0.8 pp, low confidence
MMMU-Pro86.0%estimated ± 1.5 pp, medium confidence
NL2Repo57.2%estimated ± 4.7 pp, medium confidence
PostTrainBench v145.7%estimated ± 1.3 pp, low confidence
RealWorldQA90.1%estimated ± 1.4 pp, low confidence
ScreenSpot Pro92.7%measured
SuperGPQA83.4%estimated ± 8.5 pp, low confidence
Terminal-Bench 2.083.1%estimated ± 5.8 pp, low confidence
Toolathlon62.6%estimated ± 4.2 pp, high confidence
V*96.5%estimated ± 6.5 pp, low confidence
Video-MME (w/o subtitle)91.9%estimated ± 1.7 pp, low confidence
Video-MME (with subtitle)92.3%estimated ± 3.7 pp, low confidence
HealthBench Hard36.6%measured
MedXpertQA (MM)77.8%estimated ± 6.5 pp, low confidence
MedXpertQA (Text)77.7%estimated ± 4.5 pp, low confidence
MMLU-Pro (Arcee)88.8%estimated ± 3.4 pp, low confidence
React Native Evals83.5%estimated ± 3.2 pp, medium confidence
ResearchClawBench21.3%estimated ± 1.9 pp, medium confidence
PostTrainBench41.9%measured
DAYJOB17.4%measured
DAYJOB Healthcare11.2%measured
Finance Agent v273.7%estimated ± 2.4 pp, low confidence
BioMysteryBench (human-solvable)89.5%estimated ± 0.6 pp, medium confidence
FrontierCode 1.1 Extended64.5%measured
HealthBench (raw)56.9%measured
HealthBench (length-adjusted)58.3%measured
HealthBench Professional64.7%measured
HealthBench Professional (raw)68.2%measured
HLE-Verified55.6%estimated ± 1.3 pp, low confidence
LABBench284.6%estimated ± 1.7 pp, medium confidence
ScarfBench65.4%measured
BlenderWorld (text-only)86.3%estimated ± 2.8 pp, low confidence
Cookie-Bench90.7%estimated ± 1.3 pp, low confidence
STEMBench2.8%measured
SimpleQA36.7%estimated ± 7.8 pp, low confidence
Agents' Last Exam59.3%measured
BabyVision w/ Python95.0%estimated ± 4.0 pp, low confidence
OpenHarmony Bench v1.058.9%estimated ± 2.4 pp, high confidence
OpenHarmony Bench v1.263.8%estimated ± 11.0 pp, low confidence
SEC-Bench Pro85.4%measured
ZeroBench45.6%estimated ± 6.7 pp, low confidence
MRCRv285.8%estimated ± 11.3 pp, low confidence
MMLongBench-Doc61.4%estimated ± 2.6 pp, low confidence
SWE-Marathon59.5%estimated ± 2.1 pp, low confidence
BioBasicsBench67.0%measured
LifeVal80.6%measured
MMMU-Pro w/ Python88.9%estimated ± 2.0 pp, medium confidence
ExploitBench Internal Port39.0%measured
PinchBench90.7%estimated ± 3.6 pp, low confidence
SWE-Atlas Codebase QnA61.5%estimated ± 4.8 pp, high confidence