benchgap
xAI · model

Grok 4.1 Fast benchmark scores

As of 2026-11-22, Grok 4.1 Fast (xAI) has measured scores on 13 benchmarks and estimated scores on 77 more.

BenchmarkScoreSource
AA-GPQA Diamond63.7%measured
AA-HLE5.1%measured
Artificial Analysis Intelligence Index11.3%measured
CritPt0.0%measured
GDPval-AA21.6%estimated ± 10.5 pp, low confidence
GPQA Diamond69.5%estimated ± 2.4 pp, high confidence
HLE16.9%estimated ± 8.5 pp, medium confidence
IFBench53.9%estimated ± 6.6 pp, low confidence
AA-LCR31.3%measured
AA-Omniscience Accuracy17.2%measured
BrowseComp69.0%estimated ± 8.8 pp, medium confidence
HLE w/ tools48.1%estimated ± 5.7 pp, medium confidence
IFEval87.6%estimated ± 2.8 pp, high confidence
LongBench v251.2%estimated ± 5.5 pp, medium confidence
τ²-bench results63.7%measured
AA-MMMU-Pro48.4%measured
APEX-Agents-AA14.3%estimated ± 9.3 pp, medium confidence
BioMysteryBench (human-difficult)0.0%estimated ± 6.8 pp, low confidence
BFCL v452.1%estimated ± 8.5 pp, low confidence
CyberGym53.4%estimated ± 11.0 pp, low confidence
JobBench21.8%estimated ± 14.2 pp, low confidence
WideResearch70.4%estimated ± 3.3 pp, high confidence
AA Agentic Index17.9%estimated ± 9.4 pp, medium confidence
MMLU-Pro81.5%estimated ± 5.0 pp, medium confidence
AA-IFBench36.5%measured
FailureSensorIQ62.3%estimated ± 1.7 pp, medium confidence
GPQA66.7%estimated ± 6.1 pp, medium confidence
MMLU80.6%estimated ± 0.9 pp, high confidence
Vals GPQA Diamond62.8%estimated ± 3.2 pp, high confidence
Vals MMLU-Pro74.8%estimated ± 2.9 pp, high confidence
MMMLU83.3%estimated ± 0.7 pp, medium confidence
MMMU63.5%estimated ± 2.7 pp, high confidence
Chess Puzzles19.3%estimated ± 12.3 pp, low confidence
AA MMLU-Pro83.6%estimated ± 0.8 pp, medium confidence
Gert Labs29.3%measured
ApprenticeBench3.3%estimated ± 10.4 pp, low confidence
ARC-AGI-174.7%estimated ± 7.8 pp, low confidence
ARC-AGI-230.5%estimated ± 14.4 pp, low confidence
MazeBench0.0%estimated ± 2.7 pp, high confidence
Mystery Game Puzzles4.9%estimated ± 2.2 pp, low confidence
NYT Connections12.3%measured
OSWorld-Verified65.1%estimated ± 8.6 pp, low confidence
ParseBench-142.0%estimated ± 6.2 pp, low confidence
CWE-Bench-AA39.5%estimated ± 8.1 pp, medium confidence
AA Cyber Index18.9%estimated ± 12.4 pp, low confidence
DeepsecBench-AA8.9%estimated ± 8.2 pp, low confidence
HealthBench Professional (length-adjusted, Artificial Analysis)49.2%estimated ± 4.3 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)44.1%estimated ± 1.1 pp, low confidence
AA ITBench36.7%estimated ± 4.6 pp, medium confidence
CWE-bench v138.9%estimated ± 5.7 pp, medium confidence
HLE w/o tools24.9%estimated ± 4.9 pp, high confidence
OSWorld 2.110.2%estimated ± 3.6 pp, medium confidence
OSWorld 2.1 Offline39.2%estimated ± 10.1 pp, low confidence
StealthMark41.3%estimated ± 10.7 pp, low confidence
Toolathlon-Verified62.9%estimated ± 3.0 pp, high confidence
AA AutomationBench42.8%estimated ± 9.9 pp, low confidence
GDP.pdf13.2%estimated ± 4.2 pp, medium confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
CWE-bench32.8%estimated ± 6.2 pp, low confidence
MKA32.9%estimated ± 4.6 pp, medium confidence
SkillsBench official leaderboard (BenchFlow)25.3%estimated ± 6.1 pp, medium confidence
BinaryAudit7.0%measured
OTelBench2.9%measured
Hermes Index20.0%estimated ± 5.7 pp, low confidence
ParseBench-234.4%estimated ± 6.2 pp, low confidence
CharXiv61.0%estimated ± 6.3 pp, low confidence
ExploitGym0.0%estimated ± 8.3 pp, low confidence
AI2D_TEST88.0%estimated ± 2.0 pp, low confidence
C-Eval89.0%estimated ± 1.0 pp, medium confidence
MMLU-Redux93.2%estimated ± 0.8 pp, low confidence
MMMU-Pro48.6%estimated ± 1.5 pp, high confidence
ScreenSpot Pro55.4%estimated ± 10.8 pp, low confidence
SuperGPQA64.5%estimated ± 9.3 pp, low confidence
Toolathlon37.8%estimated ± 8.0 pp, medium confidence
Video-MME (w/o subtitle)71.2%estimated ± 1.7 pp, low confidence
HealthBench Hard0.0%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
Finance Agent v255.1%estimated ± 2.4 pp, low confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
HealthBench (length-adjusted)54.1%estimated ± 3.7 pp, medium confidence
HealthBench Professional56.7%estimated ± 4.2 pp, low confidence
STEMBench2.3%estimated ± 0.2 pp, low confidence
SimpleQA14.3%estimated ± 4.3 pp, medium confidence
Agents' Last Exam29.6%estimated ± 9.7 pp, low confidence
MRCRv222.8%estimated ± 11.3 pp, low confidence
MMLongBench-Doc56.5%estimated ± 2.6 pp, low confidence
BioBasicsBench14.1%estimated ± 10.2 pp, low confidence
LifeVal6.1%estimated ± 5.0 pp, low confidence
MMMU-Pro w/ Python54.3%estimated ± 2.0 pp, medium confidence