# Decision Index Language leaderboard General · https://benchgap.net/b/jevdecisionindex03language/current · data retrieved 2026-10-29 As of 2026-10-29, the highest measured score on Decision Index Language is 67.1% by mammoth-1. 6 more models have estimated scores, calibrated from the benchmarks they were measured on. Measured scores: [benchlm.ai](https://benchlm.ai/benchmarks/jevdecisionindex03language). | # | Model | Score | Source | |---|---|---|---| | 1 | [mammoth-1](https://benchgap.net/model/mammoth-1.md) | 67.1% | measured | | 2 | [Perplexity Decider v1.2 27B](https://benchgap.net/model/pplx-decider-v1-2.md) | 65.5% | measured | | 3 | [d1-ultra](https://benchgap.net/model/d1-ultra.md) | 62.6% | estimated ± 4.2 pp, medium confidence | | 4 | [Perplexity Decider Flash v1.2 4B](https://benchgap.net/model/pplx-decider-flash-v1-2.md) | 62.2% | measured | | 5 | [Celeris-1 Decision](https://benchgap.net/model/celeris-1-decision.md) | 62.2% | estimated ± 4.2 pp, medium confidence | | 6 | [elephant-1](https://benchgap.net/model/elephant-1.md) | 62.1% | measured | | 7 | [Blink v0.3 26B-A4B (NVFP4)](https://benchgap.net/model/decision-index-0-3-blink-v0-3-26b-a4b-nvfp4.md) | 59.3% | measured | | 8 | [Surogate Rune 26B-A4B v3](https://benchgap.net/model/decision-index-rune-26b-a4b-v3.md) | 58.6% | measured | | 9 | [Quyet-1.0-Large](https://benchgap.net/model/decision-index-0-3-quyet-1-0-large.md) | 58.1% | measured | | 10 | [Jev 1.14](https://benchgap.net/model/jev-1-14.md) | 58.0% | measured | | 11 | [Kev 27B](https://benchgap.net/model/decision-index-0-3-kev-27b.md) | 57.5% | measured | | 12 | [deck31b (Gemma 4 31B)](https://benchgap.net/model/decision-index-0-3-deck31b-gemma-4-31b.md) | 57.4% | measured | | 13 | [Torchcast Decision 27B](https://benchgap.net/model/decision-index-0-3-torchcast-decision-27b.md) | 57.3% | measured | | 14 | [JPT-35B-A3B](https://benchgap.net/model/decision-index-0-3-jpt-35b-a3b.md) | 57.2% | measured | | 15 | [JADE](https://benchgap.net/model/decision-index-0-3-jade.md) | 56.5% | measured | | 16 | [simple-jev · Qwen3.8-27B](https://benchgap.net/model/decision-index-simple-jev-qwen3-8-27b.md) | 56.1% | measured | | 17 | [GEV-26B-Decide](https://benchgap.net/model/decision-index-0-3-gev-26b-decide.md) | 55.9% | measured | | 18 | [Decider chat · Gemma-4-31B](https://benchgap.net/model/decision-index-decider-chat-gemma4-31b.md) | 55.5% | measured | | 19 | [Eikos-27B](https://benchgap.net/model/eikos-27b.md) | 55.1% | measured | | 20 | [Bespoke Nimble 9B v3](https://benchgap.net/model/decision-index-0-3-bespoke-nimble-9b-v3.md) | 54.6% | measured | | 21 | [Solomon v1.1](https://benchgap.net/model/decision-index-0-3-solomon-v1-1.md) | 54.2% | measured | | 22 | [vLLM-SR Decision 2.0 Vega 27B](https://benchgap.net/model/decision-index-0-3-vllm-sr-decision-2-0-vega-27b.md) | 53.9% | measured | | 23 | [Xor 1.2](https://benchgap.net/model/decision-index-0-3-xor-1-2.md) | 53.9% | measured | | 24 | [JevK5 9B v0.3.3](https://benchgap.net/model/decision-index-0-3-jevk5-9b-v0-3-3.md) | 53.7% | measured | | 25 | [d1](https://benchgap.net/model/liquid-d1.md) | 53.6% | estimated ± 4.2 pp, medium confidence | | 26 | [Drex v2.0](https://benchgap.net/model/drex-v2-0.md) | 52.7% | measured | | 27 | [Decider chat · Qwen3.6-27B](https://benchgap.net/model/decision-index-0-3-decider-chat-qwen3-6-27b.md) | 52.6% | measured | | 28 | [JoshuaSP diffusiongemma (open-jev)](https://benchgap.net/model/decision-index-0-3-joshuasp-diffusiongemma-open-jev.md) | 51.9% | measured | | 29 | [JEV-27B](https://benchgap.net/model/decision-index-0-3-jev-27b.md) | 51.2% | measured | | 30 | [Winnow-12B Q8](https://benchgap.net/model/winnow-12b.md) | 50.6% | measured | | 31 | [decisio 0.4.0 (Qwen3.6-35B-A3B)](https://benchgap.net/model/decision-index-0-3-decisio-0-4-0-qwen3-6-35b-a3b.md) | 50.2% | measured | | 32 | [djev](https://benchgap.net/model/djev.md) | 48.6% | measured | | 33 | [decider-35b-a3b](https://benchgap.net/model/decider-35b-a3b.md) | 48.4% | measured | | 34 | [Jev-Omni](https://benchgap.net/model/jev-omni.md) | 48.1% | measured | | 35 | [Clef](https://benchgap.net/model/cloudflare-clef.md) | 47.8% | measured | | 36 | [mmastrac diffusiongemma (vLLM PR 57250)](https://benchgap.net/model/decision-index-0-3-mmastrac-diffusiongemma-vllm-pr-57250.md) | 47.7% | measured | | 37 | [ezjev 4B s2](https://benchgap.net/model/decision-index-0-3-ezjev-4b-s2.md) | 47.1% | measured | | 38 | [Hopper 12B (trained)](https://benchgap.net/model/decision-index-0-3-hopper-12b-trained.md) | 47.1% | measured | | 39 | [Microsoft-Decision-1](https://benchgap.net/model/microsoft-decision-1.md) | 46.8% | estimated ± 4.2 pp, medium confidence | | 40 | [JPT-9B](https://benchgap.net/model/decision-index-0-3-jpt-9b.md) | 46.5% | measured | | 41 | [JevK5 v0.3](https://benchgap.net/model/decision-index-0-3-jevk5-v0-3.md) | 46.3% | measured | | 42 | [razorback16 openjev diffusiongemma (NVFP4, vLLM)](https://benchgap.net/model/decision-index-0-3-razorback16-openjev-diffusiongemma-nvfp4-vllm.md) | 46.3% | measured | | 43 | [vLLM-SR Decision 2.0 Lux 9B](https://benchgap.net/model/decision-index-0-3-vllm-sr-decision-2-0-lux-9b.md) | 46.1% | measured | | 44 | [Sieve 9B](https://benchgap.net/model/decision-index-0-3-sieve-9b.md) | 45.3% | measured | | 45 | [Jevfire](https://benchgap.net/model/decision-index-0-3-jevfire.md) | 44.7% | measured | | 46 | [Bespoke Nimble 9B v2](https://benchgap.net/model/decision-index-0-3-bespoke-nimble-9b-v2.md) | 44.4% | measured | | 47 | [Kev 9B v2](https://benchgap.net/model/decision-index-0-3-kev-9b-v2.md) | 44.3% | measured | | 48 | [decisio 0.4.0 (Gemma 4 12B)](https://benchgap.net/model/decision-index-0-3-decisio-0-4-0-gemma-4-12b.md) | 44.0% | measured | | 49 | [GLiDE](https://benchgap.net/model/fastino-glide.md) | 43.2% | estimated ± 4.2 pp, medium confidence | | 50 | [RSI-Jev v5.0 VL 3B](https://benchgap.net/model/decision-index-0-3-rsi-jev-v5-0-vl-3b.md) | 42.3% | measured | | 51 | [vLLM-SR Decision 2.0 Nox 4B](https://benchgap.net/model/decision-index-0-3-vllm-sr-decision-2-0-nox-4b.md) | 42.2% | measured | | 52 | [Lev1 3.7B](https://benchgap.net/model/decision-index-0-3-lev1-3-7b.md) | 41.8% | measured | | 53 | [Intern-Decision-4B](https://benchgap.net/model/decision-index-0-3-intern-decision-4b.md) | 41.6% | measured | | 54 | [Tev1-4B-experimental](https://benchgap.net/model/decision-index-0-3-tev1-4b-experimental.md) | 41.4% | measured | | 55 | [JPT-4B](https://benchgap.net/model/decision-index-0-3-jpt-4b.md) | 41.3% | measured | | 56 | [Mercury Decide](https://benchgap.net/model/mercury-decide.md) | 41.1% | estimated ± 4.2 pp, medium confidence | | 57 | [Drex v1.5](https://benchgap.net/model/drex-v1-5.md) | 40.8% | measured | | 58 | [Clef-Omni](https://benchgap.net/model/cloudflare-clef-omni.md) | 40.7% | measured | | 59 | [JEV-9B](https://benchgap.net/model/decision-index-0-3-jev-9b.md) | 40.7% | measured | | 60 | [Clef-Flash](https://benchgap.net/model/cloudflare-clef-flash.md) | 40.5% | measured | | 61 | [Hopper (G) 1.2](https://benchgap.net/model/decision-index-0-3-hopper-g-1-2.md) | 39.8% | measured | | 62 | [Kas 4B](https://benchgap.net/model/decision-index-0-3-kas-4b.md) | 37.6% | measured | | 63 | [Winnow-E4B](https://benchgap.net/model/decision-index-0-3-winnow-e4b.md) | 37.5% | measured | | 64 | [Jevstral 8B](https://benchgap.net/model/decision-index-0-3-jevstral-8b.md) | 37.3% | measured | | 65 | [metask-jev-4b](https://benchgap.net/model/metask-jev-4b.md) | 37.0% | measured | | 66 | [open-jev (pngwn)](https://benchgap.net/model/decision-index-0-3-open-jev-pngwn.md) | 36.9% | measured | | 67 | [Intelif Qwen3-4B](https://benchgap.net/model/decision-index-0-3-intelif-qwen3-4b.md) | 36.6% | measured | | 68 | [Jobe](https://benchgap.net/model/decision-index-0-3-jobe.md) | 36.0% | measured | | 69 | [SemIf](https://benchgap.net/model/decision-index-0-3-semif.md) | 35.9% | measured | | 70 | [Kev 4B r10](https://benchgap.net/model/decision-index-0-3-kev-4b-r10.md) | 35.6% | measured | | 71 | [NeoHorse-Jev-4B](https://benchgap.net/model/decision-index-0-3-neohorse-jev-4b.md) | 34.2% | measured | | 72 | [Decider 4B](https://benchgap.net/model/decision-index-0-3-decider-4b.md) | 33.9% | measured | | 73 | [Ryotide Qwen v0.3.1](https://benchgap.net/model/decision-index-0-3-ryotide-qwen-v0-3-1.md) | 33.2% | measured | | 74 | [openvons](https://benchgap.net/model/decision-index-0-3-openvons.md) | 31.7% | measured | | 75 | [lev](https://benchgap.net/model/decision-index-0-3-lev.md) | 29.5% | measured | | 76 | [mini-jev](https://benchgap.net/model/decision-index-0-3-mini-jev.md) | 29.1% | measured | | 77 | [Intern-Decision-2B](https://benchgap.net/model/decision-index-0-3-intern-decision-2b.md) | 28.8% | measured | | 78 | [Gevva E4B](https://benchgap.net/model/decision-index-0-3-gevva-e4b.md) | 28.3% | measured | | 79 | [decider-2b](https://benchgap.net/model/decider-2b.md) | 27.4% | measured | | 80 | [vLLM-SR Decision 2.0 Sol 2B](https://benchgap.net/model/decision-index-0-3-vllm-sr-decision-2-0-sol-2b.md) | 24.0% | measured | | 81 | [this-that 1.2](https://benchgap.net/model/decision-index-0-3-this-that-1-2.md) | 23.4% | measured | | 82 | [EXAONE-4.0-1.2B-JEV v0.3](https://benchgap.net/model/decision-index-0-3-exaone-4-0-1-2b-jev-v0-3.md) | 22.2% | measured | | 83 | [Sieve 2B](https://benchgap.net/model/decision-index-0-3-sieve-2b.md) | 21.7% | measured | | 84 | [Gevva E2B](https://benchgap.net/model/decision-index-0-3-gevva-e2b.md) | 21.2% | measured | | 85 | [vLLM-SR Decision 2.0 Eos 0.8B](https://benchgap.net/model/decision-index-0-3-vllm-sr-decision-2-0-eos-0-8b.md) | 19.7% | measured | | 86 | [Bekko System One v0 400M](https://benchgap.net/model/decision-index-0-3-bekko-system-one-v0-400m.md) | 19.6% | measured | | 87 | [JPT-0.8B](https://benchgap.net/model/decision-index-0-3-jpt-0-8b.md) | 19.3% | measured | | 88 | [GLiNER2.5-Decide](https://benchgap.net/model/decision-index-0-3-gliner2-5-decide.md) | 15.5% | measured | | 89 | [Bosun v3.1 1.7B](https://benchgap.net/model/decision-index-0-3-bosun-v3-1-1-7b.md) | 14.7% | measured | | 90 | [Von 1.3](https://benchgap.net/model/decision-index-0-3-von-1-3.md) | 14.7% | measured | | 91 | [Laya](https://benchgap.net/model/laya.md) | 14.6% | measured | | 92 | [Tev1-0.8B-experimental](https://benchgap.net/model/decision-index-0-3-tev1-0-8b-experimental.md) | 14.4% | measured | | 93 | [Sifr 0.8B v3.1](https://benchgap.net/model/decision-index-0-3-sifr-0-8b-v3-1.md) | 14.3% | measured | | 94 | [JevK5 Lite](https://benchgap.net/model/decision-index-0-3-jevk5-lite.md) | 13.8% | measured | | 95 | [vLLM-SR Decision 2.0 Kai 0.6B](https://benchgap.net/model/decision-index-0-3-vllm-sr-decision-2-0-kai-0-6b.md) | 13.1% | measured | | 96 | [Kev 0.8B r15](https://benchgap.net/model/decision-index-0-3-kev-0-8b-r15.md) | 12.4% | measured | | 97 | [Jev-Style 0.8B v3](https://benchgap.net/model/decision-index-0-3-jev-style-0-8b-v3.md) | 12.0% | measured | | 98 | [Kodiak v0.2 1B (accuracy)](https://benchgap.net/model/decision-index-0-3-kodiak-v0-2-1b-accuracy.md) | 10.6% | measured | | 99 | [Lavoir](https://benchgap.net/model/decision-index-0-3-lavoir.md) | 9.2% | measured | | 100 | [Intern-Decision-0.8B](https://benchgap.net/model/decision-index-0-3-intern-decision-0-8b.md) | 8.4% | measured | | 101 | [jeff](https://benchgap.net/model/jeff.md) | 7.8% | measured | | 102 | [Qwen-2.5-1B-RLCD](https://benchgap.net/model/decision-index-0-3-qwen-2-5-1b-rlcd.md) | 7.7% | measured | | 103 | [Bekko System One v0 68M](https://benchgap.net/model/decision-index-0-3-bekko-system-one-v0-68m.md) | 6.5% | measured | | 104 | [CLM-v0.1-8B](https://benchgap.net/model/decision-index-0-3-clm-v0-1-8b.md) | 5.7% | measured | | 105 | [LFM2.5-2.6B-RLCD](https://benchgap.net/model/decision-index-0-3-lfm2-5-2-6b-rlcd.md) | 5.4% | measured | | 106 | [Bosun v3.1 0.6B](https://benchgap.net/model/bosun-v31-0-6b.md) | 5.1% | measured | | 107 | [DM-JEPA 1.1](https://benchgap.net/model/decision-index-0-3-dm-jepa-1-1.md) | 2.6% | measured | | 108 | [LFM2.5-350M-RLCD](https://benchgap.net/model/decision-index-0-3-lfm2-5-350m-rlcd.md) | 2.0% | measured | | 109 | [Zev](https://benchgap.net/model/decision-index-0-3-zev.md) | 1.8% | measured | | 110 | [system-one-gemma](https://benchgap.net/model/decision-index-0-3-system-one-gemma.md) | 1.7% | measured | | 111 | [Julia 1](https://benchgap.net/model/decision-index-0-3-julia-1.md) | 1.5% | measured | | 112 | [Bekko System One v0 17M](https://benchgap.net/model/decision-index-0-3-bekko-system-one-v0-17m.md) | 0.6% | measured | | 113 | [Verdict](https://benchgap.net/model/decision-index-0-3-verdict.md) | 0.0% | measured | ## All leaderboards ### Agentic · terminal - [AA Terminal-Bench 2.1](https://benchgap.net/b/aa-terminal-bench21/current.md) - [AA Terminal-Bench 4.0](https://benchgap.net/b/aa-terminal-bench4/current.md) - [Terminal-Bench 2.0](https://benchgap.net/b/terminal-bench-2/current.md) - [Terminal-Bench 3.0](https://benchgap.net/b/terminal-bench-3/current.md) - [Terminal-Bench 4.0](https://benchgap.net/b/terminal-bench-4/current.md) - [Terminal-Bench Hard](https://benchgap.net/b/terminal-bench-hard/current.md) - [Terminal-Bench 2.1](https://benchgap.net/b/terminalbench21/current.md) - [Terminal-Bench 2.1 (Vals AI)](https://benchgap.net/b/vals-terminal-bench21/current.md) ### Agentic · tools - [AA Agentic Index](https://benchgap.net/b/aa-agentic-index/current.md) - [AA-AnalystAgent](https://benchgap.net/b/aa-analyst-agent/current.md) - [AA AutomationBench](https://benchgap.net/b/aa-automation-bench/current.md) - [CWE-Bench-AA](https://benchgap.net/b/aa-cwe-bench/current.md) - [AA Cyber Index](https://benchgap.net/b/aa-cyber-index/current.md) - [DeepsecBench-AA](https://benchgap.net/b/aa-deepsec-bench/current.md) - [AA EnterpriseOps-Gym](https://benchgap.net/b/aa-enterprise-ops-gym/current.md) - [GDP.pdf](https://benchgap.net/b/aa-gdp-pdf/current.md) - [AA Harvey LAB v1.0](https://benchgap.net/b/aa-harvey-lab/current.md) - [AA ITBench](https://benchgap.net/b/aa-itbench/current.md) - [AA Tau3 Banking](https://benchgap.net/b/aa-tau3-banking/current.md) - [Agents' Last Exam](https://benchgap.net/b/agentslastexam/current.md) - [APEX-Agents](https://benchgap.net/b/apexagents/current.md) - [APEX-Agents-AA](https://benchgap.net/b/apexagentsaa/current.md) - [ApprenticeBench](https://benchgap.net/b/apprenticebench/current.md) - [AutomationBench](https://benchgap.net/b/automationbench/current.md) - [BFCL v4](https://benchgap.net/b/bfcl-v4/current.md) - [BrowseComp](https://benchgap.net/b/browsecomp/current.md) - [Claw-Eval](https://benchgap.net/b/claw-eval/current.md) - [CWE-bench v1](https://benchgap.net/b/cwe-bench-v1/current.md) - [CyberGym](https://benchgap.net/b/cybergym/current.md) - [DeepPlanning](https://benchgap.net/b/deepplanning/current.md) - [DeepSearchQA](https://benchgap.net/b/deepsearchqa/current.md) - [DRACO](https://benchgap.net/b/draco/current.md) - [ExploitGym](https://benchgap.net/b/exploitgym/current.md) - [Finance Agent v2](https://benchgap.net/b/financeagentv2/current.md) - [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) - [Gert Labs](https://benchgap.net/b/gertlabs/current.md) - [Hermes Bench](https://benchgap.net/b/hermesbench/current.md) - [Hermes Index](https://benchgap.net/b/hermesindex/current.md) - [HLE w/ tools](https://benchgap.net/b/hlewithtools/current.md) - [JobBench](https://benchgap.net/b/jobbench/current.md) - [MazeBench](https://benchgap.net/b/mazebench/current.md) - [MCP Atlas](https://benchgap.net/b/mcpatlas/current.md) - [MCP-Tasks](https://benchgap.net/b/mcptasks/current.md) - [OSWorld 2.1](https://benchgap.net/b/osworld-2-1/current.md) - [OSWorld 2.1 Offline](https://benchgap.net/b/osworld-2-1-offline/current.md) - [OSWorld-Verified](https://benchgap.net/b/osworld-verified/current.md) - [OSWorld 2.0](https://benchgap.net/b/osworld2/current.md) - [PinchBench](https://benchgap.net/b/pinchbench/current.md) - [QwenClawBench](https://benchgap.net/b/qwenclawbench/current.md) - [ResearchClawBench](https://benchgap.net/b/researchclawbench/current.md) - [SkillsBench](https://benchgap.net/b/skillsbench/current.md) - [τ²-bench results](https://benchgap.net/b/tau2-bench/current.md) - [τ³-bench results](https://benchgap.net/b/tau3-bench/current.md) - [Toolathlon](https://benchgap.net/b/toolathlon/current.md) - [Toolathlon-Verified](https://benchgap.net/b/toolathlonverified/current.md) - [VITA-Bench](https://benchgap.net/b/vitabench/current.md) - [WideResearch](https://benchgap.net/b/wideresearch/current.md) ### Coding - [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) - [AA LiveCodeBench](https://benchgap.net/b/aa-live-code-bench/current.md) - [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) - [Bug Hunt Bench](https://benchgap.net/b/bug-hunt-bench/current.md) - [CursorBench 3.1](https://benchgap.net/b/cursor-bench31/current.md) - [CursorBench 3.2](https://benchgap.net/b/cursor-bench32/current.md) - [CursorBench 4.0](https://benchgap.net/b/cursor-bench40/current.md) - [DeepSWE](https://benchgap.net/b/deepswe/current.md) - [FrontierCode 1.1 Main](https://benchgap.net/b/frontiercode/current.md) - [FrontierCode 2.0](https://benchgap.net/b/frontiercode-2/current.md) - [FrontierCode 1.1 Extended](https://benchgap.net/b/frontiercode11extended/current.md) - [FrontierSWE v2](https://benchgap.net/b/frontierswev2/current.md) - [LiveCodeBench](https://benchgap.net/b/livecodebench/current.md) - [LiveCodeBench Pro](https://benchgap.net/b/livecodebench-pro/current.md) - [LiveCodeBench v6](https://benchgap.net/b/livecodebench-v6/current.md) - [NL2Repo](https://benchgap.net/b/nl2repo/current.md) - [OpenHarmony Bench](https://benchgap.net/b/openharmonybench/current.md) - [PostTrainBench v1.1](https://benchgap.net/b/posttrainbench-v1-1/current.md) - [ProgramBench](https://benchgap.net/b/programbench/current.md) - [React Native Evals](https://benchgap.net/b/reactnativeevals/current.md) - [SciCode](https://benchgap.net/b/scicode/current.md) - [SWE-Atlas Codebase QnA](https://benchgap.net/b/swe-atlas-codebase-qna/current.md) - [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) - [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) - [SWE-Rebench](https://benchgap.net/b/swe-rebench/current.md) - [SWE-Marathon](https://benchgap.net/b/swemarathon/current.md) - [Vals LiveCodeBench](https://benchgap.net/b/valslivecodebench/current.md) - [Vals SWE-bench](https://benchgap.net/b/valsswebench/current.md) - [Vibe Code Bench](https://benchgap.net/b/vibecodebench/current.md) - [VulcanBench v3](https://benchgap.net/b/vulcanbench/current.md) ### Math - [AIME 2024](https://benchgap.net/b/aime2024/current.md) - [AIME 2025](https://benchgap.net/b/aime2025/current.md) - [AIME26](https://benchgap.net/b/aime2026/current.md) - [FrontierMath v2 (Tier 4)](https://benchgap.net/b/frontiermathv2tier4/current.md) - [FrontierMath v2 (Tiers 1-3)](https://benchgap.net/b/frontiermathv2tiers13/current.md) - [HMMT Feb 2025](https://benchgap.net/b/hmmtfeb2025/current.md) - [HMMT Feb 2026](https://benchgap.net/b/hmmtfeb2026/current.md) - [HMMT Nov 2025](https://benchgap.net/b/hmmtnov2025/current.md) - [IMOAnswerBench](https://benchgap.net/b/imoanswerbench/current.md) - [MATH-500](https://benchgap.net/b/math-500/current.md) - [MMAnswerBench](https://benchgap.net/b/mmanswerbench/current.md) ### Knowledge & reasoning - [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) - [AA-HLE](https://benchgap.net/b/aa-hle/current.md) - [AA MMLU-Pro](https://benchgap.net/b/aa-mmlu-pro/current.md) - [ARC-AGI-2](https://benchgap.net/b/arc-agi-2/current.md) - [ARC-AGI-3 Provider Adapter](https://benchgap.net/b/arc-agi-3-provider-adapter/current.md) - [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) - [ARC-AGI-3](https://benchgap.net/b/arcagi3/current.md) - [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) - [BBH](https://benchgap.net/b/bbh/current.md) - [BioMysteryBench (human-difficult)](https://benchgap.net/b/biomysterybenchhumandifficult/current.md) - [BioMysteryBench (human-solvable)](https://benchgap.net/b/biomysterybenchhumansolvable/current.md) - [C-Eval](https://benchgap.net/b/ceval/current.md) - [CritPt](https://benchgap.net/b/critpt/current.md) - [GPQA](https://benchgap.net/b/gpqa/current.md) - [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) - [GraphWalks BFS 256K–1M](https://benchgap.net/b/graphwalks-bfs-256k-1m/current.md) - [HealthBench (raw)](https://benchgap.net/b/healthbench/current.md) - [HealthBench Hard](https://benchgap.net/b/healthbench-hard/current.md) - [HealthBench (length-adjusted)](https://benchgap.net/b/healthbenchlengthadjusted/current.md) - [HealthBench Professional](https://benchgap.net/b/healthbenchprofessional/current.md) - [HealthBench Professional (raw)](https://benchgap.net/b/healthbenchprofessionalraw/current.md) - [HLE](https://benchgap.net/b/hle/current.md) - [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) - [HLE-Verified](https://benchgap.net/b/hleverified/current.md) - [JevBench 1.4](https://benchgap.net/b/jev-bench14/current.md) - [LABBench2](https://benchgap.net/b/labbench2/current.md) - [MedXpertQA (Text)](https://benchgap.net/b/medxpertqatext/current.md) - [MMLU](https://benchgap.net/b/mmlu/current.md) - [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) - [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) - [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) - [MMMLU](https://benchgap.net/b/mmmlu/current.md) - [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) - [SimpleQA](https://benchgap.net/b/simpleqa/current.md) - [STEMBench](https://benchgap.net/b/stembench/current.md) - [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) - [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) - [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) ### Instruction following - [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) - [IFBench](https://benchgap.net/b/ifbench/current.md) - [IFEval](https://benchgap.net/b/ifeval/current.md) ### Multilingual - [INCLUDE](https://benchgap.net/b/include/current.md) - [MAXIFE](https://benchgap.net/b/maxife/current.md) - [MMLU-ProX](https://benchgap.net/b/mmluprox/current.md) - [NOVA-63](https://benchgap.net/b/nova63/current.md) - [PolyMath](https://benchgap.net/b/polymath/current.md) - [SWE Multilingual](https://benchgap.net/b/swe-bench-multilingual/current.md) ### Vision & documents - [AA-MMMU-Pro](https://benchgap.net/b/aa-mmmu-pro/current.md) - [AI2D_TEST](https://benchgap.net/b/ai2dtest/current.md) - [BabyVision](https://benchgap.net/b/babyvision/current.md) - [CC-OCR](https://benchgap.net/b/ccocr/current.md) - [Chartography (tools)](https://benchgap.net/b/chartographywithtools/current.md) - [CharXiv](https://benchgap.net/b/charxiv/current.md) - [CharXiv w/o tools](https://benchgap.net/b/charxivnotools/current.md) - [CountBench](https://benchgap.net/b/countbench/current.md) - [DynaMath](https://benchgap.net/b/dynamath/current.md) - [ERQA](https://benchgap.net/b/erqa/current.md) - [LVBench](https://benchgap.net/b/lvbench/current.md) - [MathVision](https://benchgap.net/b/mathvision/current.md) - [MathVision w/ Python](https://benchgap.net/b/mathvisionpython/current.md) - [MedXpertQA (MM)](https://benchgap.net/b/medxpertqamm/current.md) - [MLVU (M-Avg)](https://benchgap.net/b/mlvuavg/current.md) - [MMMU](https://benchgap.net/b/mmmu/current.md) - [MMMU-Pro](https://benchgap.net/b/mmmu-pro/current.md) - [MMMU-Pro w/ Python](https://benchgap.net/b/mmmupropython/current.md) - [MMVU](https://benchgap.net/b/mmvu/current.md) - [OCRBench V2](https://benchgap.net/b/ocrbenchv2/current.md) - [OfficeQA Pro](https://benchgap.net/b/officeqapro/current.md) - [OmniDocBench 1.5](https://benchgap.net/b/omnidocbench15/current.md) - [ParseBench](https://benchgap.net/b/parsebench/current.md) - [RealWorldQA](https://benchgap.net/b/realworldqa/current.md) - [RefCOCO (avg)](https://benchgap.net/b/refcocoavg/current.md) - [ScreenSpot Pro](https://benchgap.net/b/screenspot-pro/current.md) - [SimpleVQA](https://benchgap.net/b/simplevqa/current.md) - [SWE-bench Multimodal](https://benchgap.net/b/swe-bench-multimodal/current.md) - [Video-MME (w/o subtitle)](https://benchgap.net/b/videommenosub/current.md) - [Video-MME (with subtitle)](https://benchgap.net/b/videommewithsub/current.md) - [VideoMMMU](https://benchgap.net/b/videommmu/current.md) - [V*](https://benchgap.net/b/vstar/current.md) - [We-Math](https://benchgap.net/b/wemath/current.md) - [ZeroBench](https://benchgap.net/b/zerobench/current.md) ### Long context - [AA-LCR](https://benchgap.net/b/lcr/current.md) - [LongBench v2](https://benchgap.net/b/longbench-v2/current.md) - [MMLongBench-Doc](https://benchgap.net/b/mmlongbenchdoc/current.md) - [MRCRv2](https://benchgap.net/b/mrcrv2/current.md) ### General - [HLE-MultiChoice (Decision Index)](https://benchgap.net/b/aa-decision-hle-multi-choice/current.md) - [Artificial Analysis Decision Index](https://benchgap.net/b/aa-decision-index/current.md) - [When2Call (Decision Index)](https://benchgap.net/b/aa-decision-when2-call/current.md) - [WildGuardTest (Decision Index)](https://benchgap.net/b/aa-decision-wild-guard-test/current.md) - [Decision Index Full Score](https://benchgap.net/b/decisionindex/current.md) - [ExploitBench](https://benchgap.net/b/exploitbench/current.md) - [Decision Index Arts](https://benchgap.net/b/jevdecisionindex03arts/current.md) - [Decision Index Knowledge](https://benchgap.net/b/jevdecisionindex03knowledge/current.md) - [Decision Index Language](https://benchgap.net/b/jevdecisionindex03language/current.md) - [Decision Index Retrieval](https://benchgap.net/b/jevdecisionindex03retrieval/current.md) - [Decision Index Tools](https://benchgap.net/b/jevdecisionindex03tools/current.md) - [SEC-Bench Pro](https://benchgap.net/b/secbenchpro/current.md)