benchgap
xAI · model

Grok Code Fast 1 benchmark scores

As of 2026-11-21, Grok Code Fast 1 (xAI) has measured scores on 11 benchmarks and estimated scores on 55 more.

BenchmarkScoreSource
AA-GPQA Diamond72.7%measured
AA-HLE8.0%measured
AA-SciCode44.1%estimated ± 3.8 pp, high confidence
Artificial Analysis Intelligence Index14.1%measured
CritPt0.0%measured
GDPval-AA10.1%estimated ± 11.0 pp, low confidence
GPQA Diamond71.9%estimated ± 2.4 pp, high confidence
HLE17.7%estimated ± 8.5 pp, medium confidence
IFBench54.3%estimated ± 6.6 pp, low confidence
AA-LCR53.0%measured
AA-Omniscience Accuracy23.5%measured
SciCode43.3%estimated ± 3.6 pp, high confidence
BrowseComp64.9%estimated ± 13.0 pp, low confidence
HLE w/ tools26.2%estimated ± 5.5 pp, low confidence
IFEval89.3%estimated ± 2.8 pp, high confidence
LongBench v252.7%estimated ± 5.5 pp, medium confidence
τ²-bench results75.7%measured
AA Coding Index41.8%estimated ± 5.3 pp, medium confidence
APEX-Agents-AA1.6%estimated ± 11.4 pp, low confidence
BioMysteryBench (human-difficult)0.0%estimated ± 6.8 pp, low confidence
SWE-bench Verified70.8%measured
BFCL v459.1%estimated ± 8.5 pp, low confidence
SWE-bench Pro48.3%estimated ± 4.5 pp, high confidence
AA Agentic Index17.9%estimated ± 12.7 pp, low confidence
MMLU-Pro84.8%estimated ± 5.0 pp, medium confidence
AA-IFBench41.4%measured
GPQA74.8%estimated ± 6.1 pp, medium confidence
MMLU90.4%estimated ± 0.9 pp, high confidence
Vals GPQA Diamond71.8%estimated ± 3.2 pp, high confidence
Vals LiveCodeBench62.0%measured
Vals MMLU-Pro81.6%estimated ± 2.9 pp, high confidence
MMMLU83.3%estimated ± 0.7 pp, medium confidence
AA MMLU-Pro84.6%estimated ± 0.8 pp, high confidence
ARC-AGI-174.7%estimated ± 7.8 pp, low confidence
ARC-AGI-230.5%estimated ± 14.4 pp, low confidence
CursorBench 3.259.1%estimated ± 7.2 pp, low confidence
FrontierCode 1.1 Main11.3%estimated ± 4.2 pp, low confidence
Mystery Game Puzzles10.9%estimated ± 4.7 pp, medium confidence
Vals SWE-bench63.8%estimated ± 6.6 pp, medium confidence
VulcanBench v376.9%estimated ± 5.6 pp, low confidence
HealthBench Professional (length-adjusted, Artificial Analysis)50.1%estimated ± 4.3 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)48.6%estimated ± 1.1 pp, low confidence
DeepSWE30.6%estimated ± 12.7 pp, low confidence
HLE w/o tools27.1%estimated ± 4.9 pp, high confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
CompileBench64.4%measured
Vibe Code Bench0.1%estimated ± 8.4 pp, medium confidence
C-Eval89.8%estimated ± 1.0 pp, medium confidence
MMLU-Redux93.9%estimated ± 0.8 pp, medium confidence
NL2Repo27.5%estimated ± 6.2 pp, medium confidence
SuperGPQA65.3%estimated ± 9.3 pp, medium confidence
HealthBench Hard0.0%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
React Native Evals75.5%estimated ± 2.7 pp, medium confidence
SWE-Rebench57.0%estimated ± 3.6 pp, medium confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
HealthBench (length-adjusted)54.1%estimated ± 3.7 pp, medium confidence
HealthBench Professional56.7%estimated ± 4.2 pp, low confidence
HLE-Verified18.5%estimated ± 7.1 pp, low confidence
STEMBench2.4%estimated ± 0.2 pp, low confidence
SimpleQA22.9%estimated ± 4.3 pp, medium confidence
LiveCodeBench73.5%estimated ± 14.6 pp, low confidence
MRCRv223.1%estimated ± 11.3 pp, low confidence
MMLongBench-Doc59.7%estimated ± 2.6 pp, low confidence
BioBasicsBench34.1%estimated ± 3.8 pp, low confidence