benchgap
Other · model

Spark-X2.6-4B benchmark scores

As of 2026-10-29, Spark-X2.6-4B (Other) has measured scores on 21 benchmarks and estimated scores on 82 more.

BenchmarkScoreSource
AA-GPQA Diamond82.9%estimated ± 2.7 pp, high confidence
AA-HLE15.0%estimated ± 3.8 pp, high confidence
AA-SciCode37.2%estimated ± 3.0 pp, high confidence
AIME2691.2%measured
CritPt0.4%estimated ± 4.0 pp, high confidence
GDPval-AA19.5%estimated ± 5.5 pp, medium confidence
GPQA Diamond77.1%measured
HLE23.2%estimated ± 6.6 pp, medium confidence
IFBench75.8%measured
AA-LCR67.3%measured
LiveCodeBench v687.4%estimated ± 2.7 pp, high confidence
SciCode36.8%measured
BrowseComp53.1%measured
HLE w/ tools36.9%measured
IFEval93.6%measured
LongBench v253.3%measured
VITA-Bench23.2%estimated ± 6.7 pp, low confidence
τ²-bench results86.9%measured
AA Coding Index30.4%estimated ± 5.3 pp, medium confidence
APEX-Agents19.8%estimated ± 0.6 pp, medium confidence
APEX-Agents-AA8.9%estimated ± 4.2 pp, medium confidence
DeepSearchQA75.2%estimated ± 7.3 pp, low confidence
SWE-bench Verified62.8%measured
BFCL v471.8%measured
CyberGym38.9%estimated ± 7.3 pp, low confidence
JobBench34.4%estimated ± 6.4 pp, medium confidence
SWE-bench Pro54.3%measured
τ³-bench results34.7%measured
WideResearch62.4%estimated ± 3.5 pp, medium confidence
AA Agentic Index4.9%estimated ± 5.9 pp, medium confidence
MMLU-Pro84.1%estimated ± 2.5 pp, medium confidence
AA-IFBench74.9%estimated ± 7.4 pp, medium confidence
Artificial Analysis Intelligence Index4.4%estimated ± 6.1 pp, low confidence
GPQA69.9%measured
MMLU87.9%estimated ± 4.3 pp, high confidence
AA-Omniscience Accuracy21.7%estimated ± 8.1 pp, medium confidence
MATH-50097.1%estimated ± 3.1 pp, medium confidence
MMMLU82.3%estimated ± 1.1 pp, low confidence
AA MMLU-Pro84.8%estimated ± 1.0 pp, low confidence
AIME 202591.9%estimated ± 1.5 pp, medium confidence
Gert Labs33.5%estimated ± 7.4 pp, medium confidence
AA Harvey LAB v1.081.5%estimated ± 1.7 pp, low confidence
AA Tau3 Banking19.2%estimated ± 3.9 pp, medium confidence
ARC-AGI-122.9%estimated ± 4.0 pp, medium confidence
ARC-AGI-20.0%estimated ± 11.6 pp, low confidence
CursorBench 3.150.8%estimated ± 5.6 pp, low confidence
CursorBench 3.249.1%estimated ± 3.6 pp, medium confidence
FrontierCode 1.1 Main37.0%estimated ± 5.5 pp, medium confidence
FrontierMath v2 (Tier 4)3.8%estimated ± 4.3 pp, low confidence
FrontierMath v2 (Tiers 1-3)16.9%estimated ± 8.8 pp, low confidence
FrontierSWE v25.0%estimated ± 9.0 pp, medium confidence
MazeBench0.0%estimated ± 6.1 pp, low confidence
OSWorld-Verified72.7%estimated ± 3.8 pp, medium confidence
Vals GPQA Diamond76.0%estimated ± 2.0 pp, medium confidence
Vals LiveCodeBench83.1%estimated ± 0.8 pp, low confidence
Vals MMLU-Pro79.1%estimated ± 1.6 pp, medium confidence
Vals SWE-bench56.4%estimated ± 5.3 pp, low confidence
AA AutomationBench28.6%estimated ± 11.6 pp, low confidence
CWE-Bench-AA26.3%estimated ± 5.2 pp, low confidence
AA Cyber Index26.0%estimated ± 12.8 pp, low confidence
DeepsecBench-AA0.7%estimated ± 7.4 pp, low confidence
AA ITBench32.9%estimated ± 4.1 pp, medium confidence
CursorBench 4.031.1%estimated ± 3.6 pp, medium confidence
DeepSWE15.1%estimated ± 12.7 pp, low confidence
FrontierCode 2.018.8%estimated ± 7.1 pp, low confidence
HLE w/o tools17.9%measured
PostTrainBench v1.122.3%estimated ± 4.7 pp, medium confidence
SWE Multilingual64.7%measured
Toolathlon-Verified53.2%estimated ± 5.7 pp, medium confidence
Vibe Code Bench0.6%estimated ± 8.1 pp, low confidence
ARC-AGI-30.0%estimated ± 10.6 pp, low confidence
C-Eval88.5%estimated ± 1.2 pp, high confidence
Claw-Eval69.9%measured
DeepPlanning41.3%estimated ± 13.1 pp, low confidence
HMMT Feb 202591.7%estimated ± 1.8 pp, low confidence
HMMT Feb 202681.3%measured
HMMT Nov 202590.0%estimated ± 2.8 pp, high confidence
INCLUDE82.2%estimated ± 2.0 pp, low confidence
MCP Atlas62.4%measured
MCP-Tasks76.6%estimated ± 0.6 pp, low confidence
MMAnswerBench76.5%estimated ± 1.3 pp, medium confidence
MMLU-ProX82.2%estimated ± 1.3 pp, medium confidence
MMLU-Redux90.4%estimated ± 1.7 pp, high confidence
NL2Repo40.0%estimated ± 6.1 pp, medium confidence
QwenClawBench56.5%estimated ± 2.6 pp, high confidence
SuperGPQA49.9%estimated ± 8.2 pp, low confidence
Toolathlon26.8%estimated ± 4.2 pp, medium confidence
LiveCodeBench Pro79.1%estimated ± 6.0 pp, low confidence
MedXpertQA (Text)30.6%estimated ± 8.9 pp, low confidence
MMLU-Pro (Arcee)82.1%estimated ± 3.4 pp, medium confidence
React Native Evals71.4%estimated ± 2.3 pp, medium confidence
ResearchClawBench19.8%estimated ± 1.3 pp, high confidence
SWE-Rebench57.0%estimated ± 3.6 pp, low confidence
DRACO69.1%estimated ± 4.5 pp, low confidence
FrontierCode 1.1 Extended54.0%estimated ± 3.0 pp, low confidence
HealthBench Professional26.1%estimated ± 4.8 pp, low confidence
SimpleQA30.6%estimated ± 14.6 pp, low confidence
LiveCodeBench68.0%estimated ± 14.6 pp, low confidence
OpenHarmony Bench53.3%estimated ± 4.9 pp, low confidence
IMOAnswerBench75.2%measured
MRCRv259.9%estimated ± 11.3 pp, low confidence
MMLongBench-Doc60.8%estimated ± 2.6 pp, low confidence
PinchBench88.1%estimated ± 3.6 pp, medium confidence