# Devstral Small benchmark scores

Other · model · https://benchgap.net/model/devstral-small · data retrieved 2026-10-29

As of 2026-10-29, Devstral Small (Other) has measured scores on 9 benchmarks and estimated scores on 41 more.

| Benchmark | Score | Source |
|---|---|---|
| [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) | 41.4% | measured |
| [AA-HLE](https://benchgap.net/b/aa-hle/current.md) | 3.8% | measured |
| [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) | 31.4% | estimated ± 3.9 pp, high confidence |
| [CritPt](https://benchgap.net/b/critpt/current.md) | 0.0% | measured |
| [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) | 0.1% | estimated ± 10.9 pp, low confidence |
| [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) | 87.1% | estimated ± 2.3 pp, low confidence |
| [HLE](https://benchgap.net/b/hle/current.md) | 5.3% | estimated ± 9.7 pp, low confidence |
| [IFBench](https://benchgap.net/b/ifbench/current.md) | 53.8% | estimated ± 6.6 pp, low confidence |
| [AA-LCR](https://benchgap.net/b/lcr/current.md) | 18.7% | measured |
| [SciCode](https://benchgap.net/b/scicode/current.md) | 31.2% | estimated ± 3.3 pp, high confidence |
| [IFEval](https://benchgap.net/b/ifeval/current.md) | 86.7% | estimated ± 2.8 pp, high confidence |
| [LongBench v2](https://benchgap.net/b/longbench-v2/current.md) | 50.6% | estimated ± 5.8 pp, low confidence |
| [τ²-bench results](https://benchgap.net/b/tau2-bench/current.md) | 28.4% | measured |
| [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) | 24.1% | estimated ± 5.3 pp, medium confidence |
| [BioMysteryBench (human-difficult)](https://benchgap.net/b/biomysterybenchhumandifficult/current.md) | 0.0% | estimated ± 6.8 pp, low confidence |
| [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) | 46.8% | measured |
| [BFCL v4](https://benchgap.net/b/bfcl-v4/current.md) | 27.2% | estimated ± 8.5 pp, low confidence |
| [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) | 21.6% | estimated ± 4.6 pp, high confidence |
| [AA Agentic Index](https://benchgap.net/b/aa-agentic-index/current.md) | 1.6% | estimated ± 12.3 pp, low confidence |
| [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) | 67.8% | estimated ± 4.1 pp, high confidence |
| [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) | 34.6% | measured |
| [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) | 7.6% | measured |
| [GPQA](https://benchgap.net/b/gpqa/current.md) | 46.5% | estimated ± 6.1 pp, medium confidence |
| [MMLU](https://benchgap.net/b/mmlu/current.md) | 81.0% | estimated ± 0.7 pp, high confidence |
| [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) | 14.7% | measured |
| [MMMLU](https://benchgap.net/b/mmmlu/current.md) | 83.3% | estimated ± 0.7 pp, medium confidence |
| [AA MMLU-Pro](https://benchgap.net/b/aa-mmlu-pro/current.md) | 82.7% | estimated ± 0.6 pp, medium confidence |
| [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) | 48.6% | estimated ± 7.6 pp, low confidence |
| [ARC-AGI-2](https://benchgap.net/b/arc-agi-2/current.md) | 30.7% | estimated ± 14.6 pp, low confidence |
| [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) | 81.3% | estimated ± 5.3 pp, low confidence |
| [Vals LiveCodeBench](https://benchgap.net/b/valslivecodebench/current.md) | 15.7% | estimated ± 9.9 pp, low confidence |
| [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) | 83.9% | estimated ± 2.1 pp, medium confidence |
| [Vals SWE-bench](https://benchgap.net/b/valsswebench/current.md) | 30.7% | estimated ± 6.8 pp, low confidence |
| [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) | 28.6% | estimated ± 4.6 pp, medium confidence |
| [Vibe Code Bench](https://benchgap.net/b/vibecodebench/current.md) | 0.6% | estimated ± 8.1 pp, low confidence |
| [ARC-AGI-3](https://benchgap.net/b/arcagi3/current.md) | 1.4% | estimated ± 7.7 pp, low confidence |
| [C-Eval](https://benchgap.net/b/ceval/current.md) | 87.9% | estimated ± 1.0 pp, low confidence |
| [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) | 92.9% | estimated ± 0.8 pp, low confidence |
| [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) | 64.4% | estimated ± 9.3 pp, low confidence |
| [HealthBench Hard](https://benchgap.net/b/healthbench-hard/current.md) | 0.0% | estimated ± 8.6 pp, low confidence |
| [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) | 77.1% | estimated ± 4.0 pp, low confidence |
| [React Native Evals](https://benchgap.net/b/reactnativeevals/current.md) | 71.4% | estimated ± 2.3 pp, low confidence |
| [BioMysteryBench (human-solvable)](https://benchgap.net/b/biomysterybenchhumansolvable/current.md) | 81.7% | estimated ± 0.6 pp, low confidence |
| [HealthBench (length-adjusted)](https://benchgap.net/b/healthbenchlengthadjusted/current.md) | 53.9% | estimated ± 3.3 pp, medium confidence |
| [HealthBench Professional (raw)](https://benchgap.net/b/healthbenchprofessionalraw/current.md) | 49.4% | estimated ± 8.6 pp, low confidence |
| [STEMBench](https://benchgap.net/b/stembench/current.md) | 2.4% | estimated ± 0.2 pp, medium confidence |
| [SimpleQA](https://benchgap.net/b/simpleqa/current.md) | 10.8% | estimated ± 4.3 pp, low confidence |
| [LiveCodeBench](https://benchgap.net/b/livecodebench/current.md) | 55.5% | estimated ± 14.6 pp, low confidence |
| [MRCRv2](https://benchgap.net/b/mrcrv2/current.md) | 22.8% | estimated ± 11.3 pp, low confidence |
| [MMLongBench-Doc](https://benchgap.net/b/mmlongbenchdoc/current.md) | 52.0% | estimated ± 2.6 pp, low confidence |