benchgap
Other · model

Granite 4.2 8B benchmark scores

As of 2026-11-22, Granite 4.2 8B (Other) has measured scores on 23 benchmarks and estimated scores on 82 more.

BenchmarkScoreSource
AA-GPQA Diamond63.1%measured
AA-HLE9.7%measured
AA-SciCode31.5%measured
AIME2686.3%estimated ± 4.3 pp, medium confidence
Artificial Analysis Intelligence Index5.1%measured
CritPt0.3%measured
GDPval-AA0.0%measured
GPQA Diamond64.4%estimated ± 1.2 pp, high confidence
HLE6.3%estimated ± 6.5 pp, medium confidence
IFBench79.3%measured
AA-LCR45.0%measured
LiveCodeBench v673.2%measured
AA-Omniscience Accuracy11.8%measured
SciCode36.1%measured
Terminal-Bench 2.120.6%measured
BrowseComp28.5%estimated ± 9.0 pp, low confidence
HLE w/ tools33.8%estimated ± 5.3 pp, low confidence
IFEval94.6%estimated ± 3.6 pp, high confidence
LongBench v251.7%estimated ± 5.5 pp, medium confidence
τ²-bench results76.4%estimated ± 12.4 pp, low confidence
AA Coding Index22.4%measured
APEX-Agents0.0%estimated ± 9.4 pp, low confidence
APEX-Agents-AA6.0%estimated ± 9.5 pp, medium confidence
BioMysteryBench (human-difficult)6.5%estimated ± 6.8 pp, low confidence
DeepSearchQA49.2%estimated ± 4.5 pp, medium confidence
SWE-bench Verified47.7%measured
AutomationBench47.6%estimated ± 9.1 pp, low confidence
BFCL v452.4%measured
CyberGym48.4%estimated ± 5.3 pp, low confidence
JobBench0.0%estimated ± 8.7 pp, low confidence
SWE-bench Pro19.1%measured
τ³-bench results58.1%measured
WideResearch0.0%estimated ± 7.8 pp, low confidence
AA Agentic Index3.7%measured
MMLU-Pro74.0%measured
AA-IFBench80.3%estimated ± 7.4 pp, medium confidence
AIME 202490.1%estimated ± 2.6 pp, high confidence
BBH92.3%estimated ± 2.8 pp, medium confidence
GPQA64.1%measured
MMLU80.3%estimated ± 0.9 pp, medium confidence
Vals GPQA Diamond62.2%estimated ± 3.2 pp, high confidence
Vals LiveCodeBench82.9%estimated ± 0.8 pp, low confidence
Vals MMLU-Pro76.2%estimated ± 2.3 pp, high confidence
MATH-50097.8%estimated ± 2.0 pp, high confidence
MMMLU85.4%estimated ± 0.7 pp, medium confidence
AIME 202586.7%measured
AA MMLU-Pro82.8%estimated ± 0.8 pp, medium confidence
Gert Labs26.9%estimated ± 10.0 pp, low confidence
AA Harvey LAB v1.079.4%estimated ± 1.2 pp, low confidence
AA Tau3 Banking18.1%estimated ± 3.7 pp, medium confidence
ARC-AGI-175.0%estimated ± 7.8 pp, low confidence
ARC-AGI-231.1%estimated ± 14.4 pp, low confidence
FrontierCode 1.1 Main14.6%estimated ± 5.0 pp, medium confidence
FrontierSWE v20.0%estimated ± 8.3 pp, low confidence
MazeBench0.4%estimated ± 5.5 pp, low confidence
OSWorld-Verified55.4%estimated ± 8.4 pp, low confidence
Vals SWE-bench54.4%estimated ± 5.3 pp, low confidence
Terminal-Bench 2.1 (Vals AI)22.6%estimated ± 7.3 pp, low confidence
CWE-Bench-AA0.0%estimated ± 10.1 pp, low confidence
AA Cyber Index2.7%estimated ± 9.2 pp, low confidence
DeepsecBench-AA0.0%estimated ± 8.9 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)1.2%estimated ± 2.5 pp, low confidence
AA ITBench34.0%estimated ± 4.0 pp, medium confidence
Bug Hunt Bench9.9%estimated ± 10.5 pp, low confidence
CWE-bench v10.0%estimated ± 6.4 pp, low confidence
DeepSWE10.9%estimated ± 7.5 pp, low confidence
DRACO0.0%estimated ± 2.0 pp, low confidence
HLE w/o tools19.9%estimated ± 4.9 pp, high confidence
SWE Multilingual30.8%measured
Toolathlon-Verified13.5%estimated ± 2.3 pp, low confidence
VulcanBench Frontier v459.3%estimated ± 6.8 pp, low confidence
GDP.pdf17.0%estimated ± 4.6 pp, medium confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
Vibe Code Bench0.0%estimated ± 8.4 pp, low confidence
Hermes Bench0.0%estimated ± 2.9 pp, medium confidence
Hermes Index0.0%estimated ± 8.7 pp, low confidence
ExploitGym0.0%estimated ± 12.2 pp, low confidence
C-Eval87.1%estimated ± 1.0 pp, low confidence
HMMT Feb 202578.3%measured
HMMT Feb 202664.2%estimated ± 11.0 pp, low confidence
HMMT Nov 202578.7%estimated ± 1.5 pp, high confidence
MCP Atlas64.6%estimated ± 7.8 pp, low confidence
MMLU-Redux86.8%estimated ± 0.6 pp, high confidence
NL2Repo21.2%estimated ± 3.4 pp, medium confidence
QwenClawBench55.9%estimated ± 6.0 pp, low confidence
SuperGPQA44.3%estimated ± 8.5 pp, low confidence
Toolathlon27.0%estimated ± 6.3 pp, low confidence
AA LiveCodeBench84.0%estimated ± 4.7 pp, low confidence
HealthBench Hard3.5%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)78.3%estimated ± 4.0 pp, low confidence
React Native Evals65.1%estimated ± 2.7 pp, low confidence
ResearchClawBench6.2%estimated ± 1.9 pp, medium confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
HealthBench (length-adjusted)54.1%estimated ± 3.7 pp, medium confidence
HealthBench Professional56.7%estimated ± 4.2 pp, low confidence
ScarfBench24.4%estimated ± 9.1 pp, low confidence
STEMBench2.3%estimated ± 0.2 pp, low confidence
SimpleQA6.8%estimated ± 4.3 pp, low confidence
LiveCodeBench56.2%estimated ± 14.6 pp, low confidence
OpenHarmony Bench v1.051.0%estimated ± 2.4 pp, medium confidence
MRCRv222.8%estimated ± 11.3 pp, low confidence
MMLongBench-Doc58.9%estimated ± 2.6 pp, low confidence
BioBasicsBench6.6%estimated ± 10.2 pp, low confidence
PinchBench63.3%estimated ± 5.0 pp, low confidence