benchgap
xAI · model

Grok 4.1 Fast (Reasoning) benchmark scores

As of 2026-10-07, Grok 4.1 Fast (Reasoning) (xAI) has measured scores on 10 benchmarks and estimated scores on 54 more.

BenchmarkScoreSource
AA-GPQA Diamond85.3%measured
AA-HLE19.3%measured
AA-SciCode45.9%estimated ± 3.8 pp, high confidence
Artificial Analysis Intelligence Index20.4%measured
CritPt2.9%measured
GDPval-AA26.8%estimated ± 12.5 pp, low confidence
GPQA Diamond80.9%estimated ± 2.2 pp, high confidence
HLE33.2%estimated ± 9.5 pp, medium confidence
IFBench58.2%estimated ± 6.9 pp, medium confidence
AA-LCR74.0%measured
AA-Omniscience Accuracy25.1%measured
IFEval91.8%estimated ± 1.3 pp, high confidence
LongBench v261.5%estimated ± 5.9 pp, medium confidence
τ²-bench results93.3%measured
AA Coding Index39.3%estimated ± 6.8 pp, medium confidence
AA-MMMU-Pro63.3%measured
APEX-Agents-AA25.3%estimated ± 11.4 pp, low confidence
BioMysteryBench (human-difficult)31.4%estimated ± 5.9 pp, low confidence
SWE-bench Verified71.9%estimated ± 4.4 pp, high confidence
BFCL v468.8%estimated ± 9.8 pp, low confidence
AA Agentic Index23.9%estimated ± 12.3 pp, low confidence
MMLU-Pro85.6%estimated ± 3.5 pp, high confidence
GPQA85.6%estimated ± 3.2 pp, high confidence
AA-IFBench52.7%measured
AA EnterpriseOps-Gym43.6%estimated ± 3.6 pp, medium confidence
ARC-AGI-151.9%estimated ± 5.4 pp, low confidence
ARC-AGI-217.8%estimated ± 14.2 pp, low confidence
FrontierCode 1.1 Main0.4%estimated ± 4.3 pp, low confidence
OfficeQA Pro50.3%estimated ± 7.2 pp, low confidence
Vals GPQA Diamond80.6%estimated ± 7.4 pp, medium confidence
Vals MMLU-Pro84.1%estimated ± 2.2 pp, high confidence
Vals SWE-bench62.6%estimated ± 6.3 pp, medium confidence
AA ITBench46.6%estimated ± 3.6 pp, medium confidence
HLE w/o tools16.4%estimated ± 5.7 pp, medium confidence
PostTrainBench v1.119.9%estimated ± 10.5 pp, low confidence
Vibe Code Bench1.2%measured
CharXiv70.4%estimated ± 7.5 pp, low confidence
CharXiv w/o tools71.6%estimated ± 2.4 pp, medium confidence
C-Eval91.3%estimated ± 1.0 pp, medium confidence
MathVision81.5%estimated ± 4.9 pp, high confidence
MCP-Tasks67.4%estimated ± 8.2 pp, low confidence
MMLU-Redux94.6%estimated ± 1.1 pp, medium confidence
MMMU-Pro71.4%estimated ± 4.4 pp, medium confidence
ScreenSpot Pro63.6%estimated ± 10.7 pp, low confidence
SuperGPQA70.1%estimated ± 7.5 pp, medium confidence
ERQA1.9%estimated ± 3.9 pp, medium confidence
HealthBench Hard8.2%estimated ± 7.7 pp, low confidence
MedXpertQA (MM)10.3%estimated ± 6.5 pp, low confidence
MMLU-Pro (Arcee)88.0%estimated ± 4.0 pp, medium confidence
React Native Evals13.2%estimated ± 3.0 pp, low confidence
SWE-Rebench0.0%estimated ± 6.5 pp, low confidence
ARC-AGI-31.7%estimated ± 3.4 pp, medium confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
HealthBench (raw)27.1%estimated ± 6.4 pp, low confidence
HealthBench (length-adjusted)53.9%estimated ± 3.7 pp, low confidence
HealthBench Professional57.7%estimated ± 4.8 pp, low confidence
HealthBench Professional (raw)39.3%estimated ± 5.0 pp, low confidence
HLE-Verified15.3%estimated ± 2.0 pp, low confidence
LABBench270.0%estimated ± 1.8 pp, low confidence
MMMU74.9%estimated ± 0.9 pp, high confidence
MMLU89.0%estimated ± 1.1 pp, medium confidence
MMMU-Pro w/ Python70.7%estimated ± 1.6 pp, medium confidence
RealWorldQA77.9%estimated ± 1.2 pp, low confidence
OmniDocBench 1.50.0%estimated ± 6.4 pp, low confidence