benchgap
General

Decision Index Full Score leaderboard

As of 2026-10-29, the highest measured score on Decision Index Full Score is 68.4% by mammoth-1. 6 more models have estimated scores, calibrated from the benchmarks they were measured on.

Measured scores: benchlm.ai.

#ModelScoreSource
1mammoth-168.4%measured
2Perplexity Decider v1.2 27B68.0%measured
3d1-ultra63.6%estimated ± 4.5 pp, medium confidence
4deck31b (Gemma 4 31B)63.0%measured
5Decider chat · Gemma-4-31B61.6%measured
6Torchcast Decision 27B61.5%measured
7Quyet-1.0-Large60.8%measured
8elephant-160.3%measured
9Jev 1.1460.2%measured
10Kev 27B59.6%measured
11Celeris-1 Decision59.3%estimated ± 4.5 pp, medium confidence
12GLiDE59.3%estimated ± 4.5 pp, medium confidence
13Eikos-27B58.8%measured
14Microsoft-Decision-158.4%estimated ± 4.5 pp, medium confidence
15vLLM-SR Decision 2.0 Vega 27B58.0%measured
16JEV-27B57.4%measured
17Mercury Decide57.1%estimated ± 4.5 pp, medium confidence
18simple-jev · Qwen3.8-27B57.0%measured
19Surogate Rune 26B-A4B v356.4%measured
20d156.1%estimated ± 4.5 pp, medium confidence
21Blink v0.3 26B-A4B (NVFP4)55.9%measured
22JADE55.6%measured
23Clef54.9%measured
24Decider chat · Qwen3.6-27B54.7%measured
25Perplexity Decider Flash v1.2 4B54.3%measured
26JPT-35B-A3B54.1%measured
27Xor 1.253.6%measured
28GEV-26B-Decide53.5%measured
29Drex v2.052.8%measured
30Bespoke Nimble 9B v351.1%measured
31decisio 0.4.0 (Qwen3.6-35B-A3B)50.8%measured
32JoshuaSP diffusiongemma (open-jev)49.5%measured
33decisio 0.4.0 (Gemma 4 12B)48.8%measured
34decider-35b-a3b46.6%measured
35Winnow-12B Q846.6%measured
36vLLM-SR Decision 2.0 Lux 9B46.0%measured
37Hopper 12B (trained)45.8%measured
38Drex v1.545.8%measured
39Clef-Omni45.0%measured
40JevK5 9B v0.3.344.9%measured
41Clef-Flash44.4%measured
42Jevfire44.4%measured
43JPT-9B44.1%measured
44ezjev 4B s243.9%measured
45Jev-Omni43.8%measured
46Solomon v1.143.2%measured
47Bespoke Nimble 9B v242.1%measured
48JEV-9B42.1%measured
49Sieve 9B41.7%measured
50Kev 9B v240.9%measured
51vLLM-SR Decision 2.0 Nox 4B40.8%measured
52Hopper (G) 1.240.2%measured
53JPT-4B39.6%measured
54Intern-Decision-4B38.7%measured
55RSI-Jev v5.0 VL 3B38.6%measured
56djev38.1%measured
57razorback16 openjev diffusiongemma (NVFP4, vLLM)37.6%measured
58NeoHorse-Jev-4B37.3%measured
59JevK5 v0.336.6%measured
60Decider 4B36.3%measured
61lev35.5%measured
62Lev1 3.7B35.4%measured
63Kev 4B r1034.9%measured
64mmastrac diffusiongemma (vLLM PR 57250)34.3%measured
65Kas 4B34.0%measured
66Tev1-4B-experimental33.7%measured
67Winnow-E4B32.7%measured
68Jevstral 8B32.2%measured
69metask-jev-4b32.2%measured
70Ryotide Qwen v0.3.132.0%measured
71Intelif Qwen3-4B31.3%measured
72open-jev (pngwn)31.1%measured
73Jobe30.4%measured
74Gevva E4B29.2%measured
75openvons28.8%measured
76SemIf26.7%measured
77this-that 1.224.9%measured
78Gevva E2B24.3%measured
79decider-2b23.6%measured
80vLLM-SR Decision 2.0 Sol 2B23.6%measured
81mini-jev22.8%measured
82Sieve 2B21.9%measured
83Intern-Decision-2B20.9%measured
84EXAONE-4.0-1.2B-JEV v0.320.6%measured
85vLLM-SR Decision 2.0 Eos 0.8B18.4%measured
86Bekko System One v0 400M18.0%measured
87Bosun v3.1 1.7B16.5%measured
88vLLM-SR Decision 2.0 Kai 0.6B16.4%measured
89Kev 0.8B r1516.3%measured
90JPT-0.8B15.5%measured
91Sifr 0.8B v3.114.5%measured
92Kodiak v0.2 1B (accuracy)13.9%measured
93Intern-Decision-0.8B12.7%measured
94Jev-Style 0.8B v312.5%measured
95Tev1-0.8B-experimental12.5%measured
96Bekko System One v0 68M12.4%measured
97Von 1.311.7%measured
98Bosun v3.1 0.6B11.0%measured
99Lavoir10.8%measured
100GLiNER2.5-Decide10.1%measured
101Laya9.2%measured
102JevK5 Lite8.8%measured
103LFM2.5-2.6B-RLCD8.2%measured
104Qwen-2.5-1B-RLCD7.8%measured
105Bekko System One v0 17M7.7%measured
106CLM-v0.1-8B6.5%measured
107jeff6.2%measured
108LFM2.5-350M-RLCD5.9%measured
109system-one-gemma5.2%measured
110DM-JEPA 1.15.0%measured
111Julia 14.8%measured
112Zev3.4%measured
113Verdict2.0%measured

All leaderboards

Agentic · terminal

Agentic · tools

Coding

Math

Knowledge & reasoning

Instruction following

Multilingual

Vision & documents

Long context

General