benchgap
Google · model

Gemini 1.5 Flash benchmark scores

As of 2026-10-29, Gemini 1.5 Flash (Google) has measured scores on 9 benchmarks and estimated scores on 45 more.

BenchmarkScoreSource
AA-GPQA Diamond46.3%measured
AA-HLE3.2%measured
AA-SciCode7.4%estimated ± 3.9 pp, medium confidence
AIME2620.5%estimated ± 4.6 pp, low confidence
CritPt0.2%estimated ± 2.4 pp, high confidence
GPQA Diamond50.4%estimated ± 1.2 pp, high confidence
HLE2.1%estimated ± 6.9 pp, low confidence
SciCode7.3%estimated ± 3.3 pp, medium confidence
AA Coding Index23.4%estimated ± 5.3 pp, low confidence
AA-MMMU-Pro48.4%measured
SWE-bench Verified9.6%measured
SWE-bench Pro0.0%estimated ± 4.6 pp, medium confidence
MMLU-Pro66.2%estimated ± 4.1 pp, medium confidence
AIME 202425.1%estimated ± 2.6 pp, medium confidence
Artificial Analysis Intelligence Index7.1%measured
BBH82.7%estimated ± 4.5 pp, low confidence
GPQA50.0%measured
MMLU81.0%estimated ± 2.7 pp, high confidence
AA-Omniscience Accuracy13.7%estimated ± 2.7 pp, low confidence
MATH-50089.1%estimated ± 2.1 pp, medium confidence
MMMLU72.5%estimated ± 1.7 pp, high confidence
MMMU58.3%measured
AA MMLU-Pro83.3%estimated ± 1.1 pp, medium confidence
AIME 202514.7%measured
ARC-AGI-159.7%estimated ± 8.1 pp, low confidence
ARC-AGI-230.7%estimated ± 14.6 pp, low confidence
ParseBench41.8%estimated ± 5.5 pp, low confidence
Vals GPQA Diamond81.3%estimated ± 5.3 pp, low confidence
Vals MMLU-Pro83.9%estimated ± 2.1 pp, medium confidence
HLE w/o tools28.6%estimated ± 4.6 pp, medium confidence
ARC-AGI-31.4%estimated ± 7.7 pp, low confidence
CharXiv60.8%estimated ± 6.2 pp, low confidence
AI2D_TEST87.3%estimated ± 2.0 pp, high confidence
C-Eval87.7%estimated ± 1.0 pp, low confidence
CountBench92.6%estimated ± 3.2 pp, high confidence
DynaMath79.2%estimated ± 5.8 pp, low confidence
ERQA47.1%estimated ± 5.2 pp, low confidence
MathVision54.7%estimated ± 3.6 pp, high confidence
MLVU (M-Avg)74.1%estimated ± 2.4 pp, high confidence
MMLU-Redux87.6%estimated ± 1.2 pp, low confidence
MMMU-Pro48.5%estimated ± 1.6 pp, high confidence
RealWorldQA74.9%estimated ± 3.6 pp, high confidence
ScreenSpot Pro53.0%estimated ± 7.3 pp, low confidence
SimpleVQA42.5%estimated ± 7.1 pp, medium confidence
SuperGPQA61.7%estimated ± 10.1 pp, low confidence
Video-MME (w/o subtitle)64.0%estimated ± 1.3 pp, high confidence
Video-MME (with subtitle)70.3%estimated ± 3.2 pp, high confidence
VideoMMMU48.1%estimated ± 3.8 pp, high confidence
We-Math68.8%estimated ± 7.2 pp, low confidence
HealthBench (length-adjusted)53.9%estimated ± 3.3 pp, medium confidence
HealthBench Professional (raw)49.2%estimated ± 8.6 pp, low confidence
SimpleQA8.6%measured
MMVU58.7%estimated ± 3.8 pp, medium confidence
MMMU-Pro w/ Python54.3%estimated ± 2.0 pp, medium confidence