benchgap
Other · model

Granite-4.0-H-1B benchmark scores

As of 2026-11-22, Granite-4.0-H-1B (Other) has measured scores on 11 benchmarks and estimated scores on 30 more.

BenchmarkScoreSource
AA-GPQA Diamond26.3%measured
AA-HLE5.0%measured
Artificial Analysis Intelligence Index12.6%estimated ± 7.2 pp, medium confidence
CritPt0.0%measured
GDPval-AA0.0%estimated ± 11.0 pp, low confidence
GPQA Diamond30.3%estimated ± 1.2 pp, high confidence
HLE16.9%estimated ± 8.5 pp, medium confidence
IFBench53.6%estimated ± 6.6 pp, low confidence
AA-LCR7.0%measured
AA-Omniscience Accuracy18.5%estimated ± 7.7 pp, low confidence
BrowseComp25.6%estimated ± 13.0 pp, low confidence
IFEval78.5%measured
LongBench v251.2%estimated ± 5.5 pp, low confidence
τ²-bench results19.6%measured
BioMysteryBench (human-difficult)0.0%estimated ± 6.8 pp, low confidence
BFCL v419.6%estimated ± 8.5 pp, low confidence
AA Agentic Index0.0%estimated ± 12.7 pp, low confidence
MMLU-Pro32.9%measured
AA-IFBench26.2%measured
BBH59.7%measured
GPQA29.7%measured
MMLU59.7%measured
Vals GPQA Diamond25.5%estimated ± 3.2 pp, medium confidence
Vals MMLU-Pro51.3%estimated ± 2.3 pp, medium confidence
MMMLU83.3%estimated ± 0.7 pp, medium confidence
AA MMLU-Pro85.7%estimated ± 1.3 pp, medium confidence
ARC-AGI-174.7%estimated ± 7.8 pp, low confidence
ARC-AGI-230.5%estimated ± 14.4 pp, low confidence
HLE w/o tools3.4%estimated ± 5.4 pp, low confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
C-Eval90.8%estimated ± 1.1 pp, low confidence
MMLU-Redux61.7%estimated ± 0.6 pp, medium confidence
SuperGPQA15.9%estimated ± 12.4 pp, low confidence
HealthBench Hard0.0%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
SimpleQA1.5%estimated ± 7.8 pp, low confidence
MRCRv222.8%estimated ± 11.3 pp, low confidence
MMLongBench-Doc38.9%estimated ± 2.6 pp, low confidence
BioBasicsBench33.9%estimated ± 10.7 pp, low confidence