benchgap
Other · model

Pareto 26.10 Preview benchmark scores

As of 2026-10-07, Pareto 26.10 Preview (Other) has measured scores on 3 benchmarks and estimated scores on 29 more.

BenchmarkScoreSource
AA-GPQA Diamond92.0%estimated ± 5.6 pp, medium confidence
AA-HLE41.8%estimated ± 4.0 pp, high confidence
Artificial Analysis Intelligence Index39.6%estimated ± 7.4 pp, medium confidence
CritPt17.5%estimated ± 4.9 pp, high confidence
GPQA Diamond92.4%measured
HLE47.0%estimated ± 9.2 pp, medium confidence
AA-Omniscience Accuracy42.9%estimated ± 8.6 pp, medium confidence
AA Coding Index76.1%estimated ± 2.5 pp, high confidence
SWE-bench Verified90.6%estimated ± 5.2 pp, low confidence
SWE-bench Pro73.0%estimated ± 7.8 pp, low confidence
MMLU-Pro88.5%estimated ± 5.4 pp, medium confidence
GPQA92.4%estimated ± 0.4 pp, high confidence
ARC-AGI-192.6%estimated ± 2.7 pp, high confidence
ARC-AGI-267.7%estimated ± 10.1 pp, low confidence
CursorBench 3.267.6%estimated ± 6.4 pp, low confidence
FrontierCode 1.1 Main48.8%estimated ± 3.7 pp, low confidence
Vals GPQA Diamond91.7%estimated ± 2.0 pp, high confidence
Vals MMLU-Pro87.9%estimated ± 1.6 pp, high confidence
Terminal-Bench 2.1 (Vals AI)81.7%estimated ± 4.6 pp, medium confidence
AA Terminal-Bench 4.047.0%estimated ± 4.7 pp, high confidence
DeepSWE69.9%measured
HLE w/o tools42.4%estimated ± 4.4 pp, high confidence
PostTrainBench v1.138.7%estimated ± 4.8 pp, high confidence
Terminal-Bench 4.050.8%measured
MMLU-Redux94.1%estimated ± 3.0 pp, medium confidence
NL2Repo59.7%estimated ± 6.6 pp, medium confidence
SuperGPQA80.2%estimated ± 13.9 pp, low confidence
MedXpertQA (Text)61.7%estimated ± 4.5 pp, medium confidence
MMLU-Pro (Arcee)87.7%estimated ± 3.4 pp, low confidence
ARC-AGI-30.1%estimated ± 3.8 pp, high confidence
HealthBench Professional54.8%estimated ± 4.8 pp, medium confidence
MMMLU90.6%estimated ± 1.1 pp, medium confidence