# AA LiveCodeBench leaderboard Coding · https://benchgap.net/b/aa-live-code-bench/current · data retrieved 2026-10-29 As of 2026-10-29, the highest measured score on AA LiveCodeBench is 91.7% by Gemini 3 Pro. 76 more models have estimated scores, calibrated from the benchmarks they were measured on. Measured scores: [benchlm.ai](https://benchlm.ai/benchmarks/aalivecodebench). | # | Model | Score | Source | |---|---|---|---| | 1 | [Gemini 3.5 Flash](https://benchgap.net/model/gemini-3-5-flash.md) | 92.8% | estimated ± 3.4 pp, low confidence | | 2 | [GPT-5.4 mini](https://benchgap.net/model/gpt-5-4-mini.md) | 92.7% | estimated ± 3.4 pp, low confidence | | 3 | [Gemini 3 Pro](https://benchgap.net/model/gemini-3-pro.md) | 91.7% | measured | | 4 | [GPT-5.2-Codex](https://benchgap.net/model/gpt-5-2-codex.md) | 90.6% | estimated ± 3.4 pp, low confidence | | 5 | [Kimi K2.6](https://benchgap.net/model/kimi-2-6.md) | 90.6% | estimated ± 3.4 pp, low confidence | | 6 | [GLM-4.7](https://benchgap.net/model/glm-4-7.md) | 89.4% | measured | | 7 | [Gemini 3.1 Pro](https://benchgap.net/model/gemini-3-1-pro.md) | 89.4% | estimated ± 3.4 pp, low confidence | | 8 | [GLM-5.1](https://benchgap.net/model/glm-5-1.md) | 89.2% | estimated ± 3.4 pp, low confidence | | 9 | [MiniMax M2.7](https://benchgap.net/model/minimax-m2-7.md) | 88.3% | estimated ± 3.4 pp, low confidence | | 10 | [GPT-5.4 nano](https://benchgap.net/model/gpt-5-4-nano.md) | 88.1% | estimated ± 3.4 pp, low confidence | | 11 | [Apodex 1.1](https://benchgap.net/model/apodex-1-1.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 12 | [Apodex 1.1 Mini](https://benchgap.net/model/apodex-1-1-mini.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 13 | [Hy3](https://benchgap.net/model/hy3.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 14 | [Hy3 Preview](https://benchgap.net/model/hy3-preview.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 15 | [Kimi K2.7 Code](https://benchgap.net/model/kimi-k2-7-code.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 16 | [MiMo-V2.5-Pro](https://benchgap.net/model/mimo-v2-5-pro.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 17 | [MiniMax M3](https://benchgap.net/model/minimax-m3.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 18 | [Quasar 438B](https://benchgap.net/model/quasar-438b.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 19 | [Qwen3.7 Max](https://benchgap.net/model/qwen3-7-max.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 20 | [Qwen3.7 Plus](https://benchgap.net/model/qwen3-7-plus.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 21 | [Qwen3.8-27B](https://benchgap.net/model/qwen3-8-27b.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 22 | [Qwen3.6-27B](https://benchgap.net/model/qwen3-6-27b.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 23 | [Inkling-Small](https://benchgap.net/model/inkling-small.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 24 | [Inkling](https://benchgap.net/model/inkling.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 25 | [Ling 3.0 Flash](https://benchgap.net/model/ling-3-0-flash.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 26 | [MiMo-V2-Flash](https://benchgap.net/model/mimo-v2-flash.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 27 | [Gemini 3.5 Flash-Lite](https://benchgap.net/model/gemini-3-5-flash-lite.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 28 | [Nemotron 3 Ultra](https://benchgap.net/model/nemotron-3-ultra.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 29 | [Muse Glimmer 30B](https://benchgap.net/model/muse-glimmer-30b.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 30 | [Mistral Medium 3.5 128B](https://benchgap.net/model/mistral-medium-3-5-128b.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 31 | [Kimi K2.5](https://benchgap.net/model/kimi-k2-5.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 32 | [Qwen3.5-122B-A10B](https://benchgap.net/model/qwen3-5-122b-a10b.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 33 | [Gemma 4 31B](https://benchgap.net/model/gemma-4-31b.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 34 | [Grok 4.3](https://benchgap.net/model/grok-4-3.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 35 | [Qwen3.6-35B-A3B](https://benchgap.net/model/qwen3-6-35b-a3b.md) | 88.1% | estimated ± 4.7 pp, low confidence | | 36 | [Qwen3.6 Plus](https://benchgap.net/model/qwen3-6-plus.md) | 88.0% | estimated ± 3.4 pp, low confidence | | 37 | [GPT-OSS 120B](https://benchgap.net/model/gpt-oss-120b.md) | 87.8% | measured | | 38 | [o1](https://benchgap.net/model/o1.md) | 87.7% | estimated ± 4.7 pp, low confidence | | 39 | [Step 3.7 Flash](https://benchgap.net/model/step-3-7-flash.md) | 87.6% | estimated ± 4.7 pp, low confidence | | 40 | [GLM-5 (Reasoning)](https://benchgap.net/model/glm-5-reasoning.md) | 87.5% | estimated ± 3.4 pp, low confidence | | 41 | [Claude Sonnet 4.5 Thinking](https://benchgap.net/model/claude-sonnet-4-5-thinking.md) | 87.4% | estimated ± 3.4 pp, low confidence | | 42 | [GPT-5.1-Codex-Max](https://benchgap.net/model/gpt-5-1-codex-max.md) | 87.3% | estimated ± 3.4 pp, low confidence | | 43 | [Gemma 4 26B A4B](https://benchgap.net/model/gemma-4-26b-a4b.md) | 87.3% | estimated ± 4.7 pp, low confidence | | 44 | [Claude Opus 4.5 Thinking](https://benchgap.net/model/claude-opus-4-5-thinking.md) | 87.1% | measured | | 45 | [Gemini 3 Flash](https://benchgap.net/model/gemini-3-flash.md) | 86.9% | estimated ± 3.4 pp, low confidence | | 46 | [GPT-5.1](https://benchgap.net/model/gpt-5-1.md) | 86.8% | measured | | 47 | [Muse Spark](https://benchgap.net/model/muse-spark.md) | 86.8% | estimated ± 3.4 pp, low confidence | | 48 | [Kimi K2.5 (Reasoning)](https://benchgap.net/model/kimi-k2-5-reasoning.md) | 86.3% | estimated ± 3.4 pp, low confidence | | 49 | [Qwen3.5 Plus](https://benchgap.net/model/qwen3-5-plus.md) | 86.0% | estimated ± 3.4 pp, low confidence | | 50 | [o4-mini](https://benchgap.net/model/o4-mini.md) | 85.9% | measured | | 51 | [MiniMax M2.5](https://benchgap.net/model/minimax-m2-5.md) | 85.8% | estimated ± 3.4 pp, low confidence | | 52 | [GPT-5 mini](https://benchgap.net/model/gpt-5-mini.md) | 85.6% | estimated ± 3.4 pp, low confidence | | 53 | [GPT-5.1-Codex](https://benchgap.net/model/gpt-5-1-codex.md) | 85.4% | estimated ± 3.4 pp, low confidence | | 54 | [Claude Haiku 4.5 Thinking](https://benchgap.net/model/claude-haiku-4-5-thinking.md) | 85.1% | estimated ± 3.4 pp, low confidence | | 55 | [GPT-5 (high)](https://benchgap.net/model/gpt-5-high.md) | 84.6% | measured | | 56 | [o1-preview](https://benchgap.net/model/o1-preview.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 57 | [K-Exaone](https://benchgap.net/model/k-exaone.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 58 | [Gemma 4 12B](https://benchgap.net/model/gemma-4-12b.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 59 | [Command A+](https://benchgap.net/model/command-a-plus.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 60 | [Nemotron 3.5 Lightning 30B A3B NVFP4](https://benchgap.net/model/nemotron-3-5-lightning-30b-a3b-nvfp4.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 61 | [Mistral Small 4](https://benchgap.net/model/mistral-small-4.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 62 | [Mistral Small 4 (Reasoning)](https://benchgap.net/model/mistral-small-4-reasoning.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 63 | [Trinity-Large-Preview](https://benchgap.net/model/trinity-large-preview.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 64 | [Trinity-Large-Thinking](https://benchgap.net/model/trinity-large-thinking.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 65 | [Ling 2.6 Flash](https://benchgap.net/model/ling-2-6-flash.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 66 | [Gemini 1.5 Pro](https://benchgap.net/model/gemini-1-5-pro.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 67 | [DeepSeek V3](https://benchgap.net/model/deepseek-v3.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 68 | [Granite 4.2 8B](https://benchgap.net/model/granite-4-2-8b.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 69 | [Celeris-1](https://benchgap.net/model/celeris-1.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 70 | [Claude 3 Opus](https://benchgap.net/model/claude-3-opus.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 71 | [GPT-4.1 mini](https://benchgap.net/model/gpt-4-1-mini.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 72 | [GPT-4 Turbo](https://benchgap.net/model/gpt-4-turbo.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 73 | [GPT-OSS 20B](https://benchgap.net/model/gpt-oss-20b.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 74 | [Llama 4 Maverick](https://benchgap.net/model/llama-4-maverick.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 75 | [Mistral Large 3](https://benchgap.net/model/mistral-large-3.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 76 | [Nemotron 3 Nano 30B](https://benchgap.net/model/nemotron-3-nano-30b.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 77 | [Nemotron 3 Nano Omni 30B A3B](https://benchgap.net/model/nemotron-3-nano-omni-30b-a3b.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 78 | [Ultravox v0.6 Llama 3.3 70B](https://benchgap.net/model/ultravox-v0-6-llama-3-3-70b.md) | 84.0% | estimated ± 4.7 pp, low confidence | | 79 | [DeepSeek V3.2 (Thinking)](https://benchgap.net/model/deepseek-v3-2-thinking.md) | 83.7% | estimated ± 3.4 pp, low confidence | | 80 | [Grok 4.20](https://benchgap.net/model/grok-4-20-beta.md) | 83.5% | estimated ± 3.4 pp, low confidence | | 81 | [Qwen3 Max](https://benchgap.net/model/qwen3-max.md) | 83.4% | estimated ± 3.4 pp, low confidence | | 82 | [GLM-4.6](https://benchgap.net/model/glm-4-6.md) | 83.3% | estimated ± 3.4 pp, low confidence | | 83 | [Grok 4 Fast (Reasoning)](https://benchgap.net/model/grok-4-fast-reasoning.md) | 83.2% | measured | | 84 | [Gemini 3.1 Flash-Lite](https://benchgap.net/model/gemini-3-1-flash-lite.md) | 82.7% | estimated ± 3.4 pp, low confidence | | 85 | [Grok 4.1 Fast (Reasoning)](https://benchgap.net/model/grok-4-1-fast-reasoning.md) | 82.2% | measured | | 86 | [Grok 4](https://benchgap.net/model/grok-4.md) | 81.9% | measured | | 87 | [o3](https://benchgap.net/model/o3.md) | 80.8% | measured | | 88 | [Gemini 2.5 Pro](https://benchgap.net/model/gemini-2-5-pro.md) | 80.1% | measured | ## All leaderboards ### Agentic · terminal - [AA Terminal-Bench 2.1](https://benchgap.net/b/aa-terminal-bench21/current.md) - [AA Terminal-Bench 4.0](https://benchgap.net/b/aa-terminal-bench4/current.md) - [Terminal-Bench 2.0](https://benchgap.net/b/terminal-bench-2/current.md) - [Terminal-Bench 3.0](https://benchgap.net/b/terminal-bench-3/current.md) - [Terminal-Bench 4.0](https://benchgap.net/b/terminal-bench-4/current.md) - [Terminal-Bench Hard](https://benchgap.net/b/terminal-bench-hard/current.md) - [Terminal-Bench 2.1](https://benchgap.net/b/terminalbench21/current.md) - [Terminal-Bench 2.1 (Vals AI)](https://benchgap.net/b/vals-terminal-bench21/current.md) ### Agentic · tools - [AA Agentic Index](https://benchgap.net/b/aa-agentic-index/current.md) - [AA-AnalystAgent](https://benchgap.net/b/aa-analyst-agent/current.md) - [AA AutomationBench](https://benchgap.net/b/aa-automation-bench/current.md) - [CWE-Bench-AA](https://benchgap.net/b/aa-cwe-bench/current.md) - [AA Cyber Index](https://benchgap.net/b/aa-cyber-index/current.md) - [DeepsecBench-AA](https://benchgap.net/b/aa-deepsec-bench/current.md) - [AA EnterpriseOps-Gym](https://benchgap.net/b/aa-enterprise-ops-gym/current.md) - [GDP.pdf](https://benchgap.net/b/aa-gdp-pdf/current.md) - [AA Harvey LAB v1.0](https://benchgap.net/b/aa-harvey-lab/current.md) - [AA ITBench](https://benchgap.net/b/aa-itbench/current.md) - [AA Tau3 Banking](https://benchgap.net/b/aa-tau3-banking/current.md) - [Agents' Last Exam](https://benchgap.net/b/agentslastexam/current.md) - [APEX-Agents](https://benchgap.net/b/apexagents/current.md) - [APEX-Agents-AA](https://benchgap.net/b/apexagentsaa/current.md) - [ApprenticeBench](https://benchgap.net/b/apprenticebench/current.md) - [AutomationBench](https://benchgap.net/b/automationbench/current.md) - [BFCL v4](https://benchgap.net/b/bfcl-v4/current.md) - [BrowseComp](https://benchgap.net/b/browsecomp/current.md) - [Claw-Eval](https://benchgap.net/b/claw-eval/current.md) - [CWE-bench v1](https://benchgap.net/b/cwe-bench-v1/current.md) - [CyberGym](https://benchgap.net/b/cybergym/current.md) - [DeepPlanning](https://benchgap.net/b/deepplanning/current.md) - [DeepSearchQA](https://benchgap.net/b/deepsearchqa/current.md) - [DRACO](https://benchgap.net/b/draco/current.md) - [ExploitGym](https://benchgap.net/b/exploitgym/current.md) - [Finance Agent v2](https://benchgap.net/b/financeagentv2/current.md) - [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) - [Gert Labs](https://benchgap.net/b/gertlabs/current.md) - [Hermes Bench](https://benchgap.net/b/hermesbench/current.md) - [Hermes Index](https://benchgap.net/b/hermesindex/current.md) - [HLE w/ tools](https://benchgap.net/b/hlewithtools/current.md) - [JobBench](https://benchgap.net/b/jobbench/current.md) - [MazeBench](https://benchgap.net/b/mazebench/current.md) - [MCP Atlas](https://benchgap.net/b/mcpatlas/current.md) - [MCP-Tasks](https://benchgap.net/b/mcptasks/current.md) - [OSWorld 2.1](https://benchgap.net/b/osworld-2-1/current.md) - [OSWorld 2.1 Offline](https://benchgap.net/b/osworld-2-1-offline/current.md) - [OSWorld-Verified](https://benchgap.net/b/osworld-verified/current.md) - [OSWorld 2.0](https://benchgap.net/b/osworld2/current.md) - [PinchBench](https://benchgap.net/b/pinchbench/current.md) - [QwenClawBench](https://benchgap.net/b/qwenclawbench/current.md) - [ResearchClawBench](https://benchgap.net/b/researchclawbench/current.md) - [SkillsBench](https://benchgap.net/b/skillsbench/current.md) - [τ²-bench results](https://benchgap.net/b/tau2-bench/current.md) - [τ³-bench results](https://benchgap.net/b/tau3-bench/current.md) - [Toolathlon](https://benchgap.net/b/toolathlon/current.md) - [Toolathlon-Verified](https://benchgap.net/b/toolathlonverified/current.md) - [VITA-Bench](https://benchgap.net/b/vitabench/current.md) - [WideResearch](https://benchgap.net/b/wideresearch/current.md) ### Coding - [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) - [AA LiveCodeBench](https://benchgap.net/b/aa-live-code-bench/current.md) - [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) - [Bug Hunt Bench](https://benchgap.net/b/bug-hunt-bench/current.md) - [CursorBench 3.1](https://benchgap.net/b/cursor-bench31/current.md) - [CursorBench 3.2](https://benchgap.net/b/cursor-bench32/current.md) - [CursorBench 4.0](https://benchgap.net/b/cursor-bench40/current.md) - [DeepSWE](https://benchgap.net/b/deepswe/current.md) - [FrontierCode 1.1 Main](https://benchgap.net/b/frontiercode/current.md) - [FrontierCode 2.0](https://benchgap.net/b/frontiercode-2/current.md) - [FrontierCode 1.1 Extended](https://benchgap.net/b/frontiercode11extended/current.md) - [FrontierSWE v2](https://benchgap.net/b/frontierswev2/current.md) - [LiveCodeBench](https://benchgap.net/b/livecodebench/current.md) - [LiveCodeBench Pro](https://benchgap.net/b/livecodebench-pro/current.md) - [LiveCodeBench v6](https://benchgap.net/b/livecodebench-v6/current.md) - [NL2Repo](https://benchgap.net/b/nl2repo/current.md) - [OpenHarmony Bench](https://benchgap.net/b/openharmonybench/current.md) - [PostTrainBench v1.1](https://benchgap.net/b/posttrainbench-v1-1/current.md) - [ProgramBench](https://benchgap.net/b/programbench/current.md) - [React Native Evals](https://benchgap.net/b/reactnativeevals/current.md) - [SciCode](https://benchgap.net/b/scicode/current.md) - [SWE-Atlas Codebase QnA](https://benchgap.net/b/swe-atlas-codebase-qna/current.md) - [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) - [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) - [SWE-Rebench](https://benchgap.net/b/swe-rebench/current.md) - [SWE-Marathon](https://benchgap.net/b/swemarathon/current.md) - [Vals LiveCodeBench](https://benchgap.net/b/valslivecodebench/current.md) - [Vals SWE-bench](https://benchgap.net/b/valsswebench/current.md) - [Vibe Code Bench](https://benchgap.net/b/vibecodebench/current.md) - [VulcanBench v3](https://benchgap.net/b/vulcanbench/current.md) ### Math - [AIME 2024](https://benchgap.net/b/aime2024/current.md) - [AIME 2025](https://benchgap.net/b/aime2025/current.md) - [AIME26](https://benchgap.net/b/aime2026/current.md) - [FrontierMath v2 (Tier 4)](https://benchgap.net/b/frontiermathv2tier4/current.md) - [FrontierMath v2 (Tiers 1-3)](https://benchgap.net/b/frontiermathv2tiers13/current.md) - [HMMT Feb 2025](https://benchgap.net/b/hmmtfeb2025/current.md) - [HMMT Feb 2026](https://benchgap.net/b/hmmtfeb2026/current.md) - [HMMT Nov 2025](https://benchgap.net/b/hmmtnov2025/current.md) - [IMOAnswerBench](https://benchgap.net/b/imoanswerbench/current.md) - [MATH-500](https://benchgap.net/b/math-500/current.md) - [MMAnswerBench](https://benchgap.net/b/mmanswerbench/current.md) ### Knowledge & reasoning - [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) - [AA-HLE](https://benchgap.net/b/aa-hle/current.md) - [AA MMLU-Pro](https://benchgap.net/b/aa-mmlu-pro/current.md) - [ARC-AGI-2](https://benchgap.net/b/arc-agi-2/current.md) - [ARC-AGI-3 Provider Adapter](https://benchgap.net/b/arc-agi-3-provider-adapter/current.md) - [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) - [ARC-AGI-3](https://benchgap.net/b/arcagi3/current.md) - [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) - [BBH](https://benchgap.net/b/bbh/current.md) - [BioMysteryBench (human-difficult)](https://benchgap.net/b/biomysterybenchhumandifficult/current.md) - [BioMysteryBench (human-solvable)](https://benchgap.net/b/biomysterybenchhumansolvable/current.md) - [C-Eval](https://benchgap.net/b/ceval/current.md) - [CritPt](https://benchgap.net/b/critpt/current.md) - [GPQA](https://benchgap.net/b/gpqa/current.md) - [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) - [GraphWalks BFS 256K–1M](https://benchgap.net/b/graphwalks-bfs-256k-1m/current.md) - [HealthBench (raw)](https://benchgap.net/b/healthbench/current.md) - [HealthBench Hard](https://benchgap.net/b/healthbench-hard/current.md) - [HealthBench (length-adjusted)](https://benchgap.net/b/healthbenchlengthadjusted/current.md) - [HealthBench Professional](https://benchgap.net/b/healthbenchprofessional/current.md) - [HealthBench Professional (raw)](https://benchgap.net/b/healthbenchprofessionalraw/current.md) - [HLE](https://benchgap.net/b/hle/current.md) - [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) - [HLE-Verified](https://benchgap.net/b/hleverified/current.md) - [JevBench 1.4](https://benchgap.net/b/jev-bench14/current.md) - [LABBench2](https://benchgap.net/b/labbench2/current.md) - [MedXpertQA (Text)](https://benchgap.net/b/medxpertqatext/current.md) - [MMLU](https://benchgap.net/b/mmlu/current.md) - [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) - [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) - [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) - [MMMLU](https://benchgap.net/b/mmmlu/current.md) - [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) - [SimpleQA](https://benchgap.net/b/simpleqa/current.md) - [STEMBench](https://benchgap.net/b/stembench/current.md) - [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) - [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) - [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) ### Instruction following - [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) - [IFBench](https://benchgap.net/b/ifbench/current.md) - [IFEval](https://benchgap.net/b/ifeval/current.md) ### Multilingual - [INCLUDE](https://benchgap.net/b/include/current.md) - [MAXIFE](https://benchgap.net/b/maxife/current.md) - [MMLU-ProX](https://benchgap.net/b/mmluprox/current.md) - [NOVA-63](https://benchgap.net/b/nova63/current.md) - [PolyMath](https://benchgap.net/b/polymath/current.md) - [SWE Multilingual](https://benchgap.net/b/swe-bench-multilingual/current.md) ### Vision & documents - [AA-MMMU-Pro](https://benchgap.net/b/aa-mmmu-pro/current.md) - [AI2D_TEST](https://benchgap.net/b/ai2dtest/current.md) - [BabyVision](https://benchgap.net/b/babyvision/current.md) - [CC-OCR](https://benchgap.net/b/ccocr/current.md) - [Chartography (tools)](https://benchgap.net/b/chartographywithtools/current.md) - [CharXiv](https://benchgap.net/b/charxiv/current.md) - [CharXiv w/o tools](https://benchgap.net/b/charxivnotools/current.md) - [CountBench](https://benchgap.net/b/countbench/current.md) - [DynaMath](https://benchgap.net/b/dynamath/current.md) - [ERQA](https://benchgap.net/b/erqa/current.md) - [LVBench](https://benchgap.net/b/lvbench/current.md) - [MathVision](https://benchgap.net/b/mathvision/current.md) - [MathVision w/ Python](https://benchgap.net/b/mathvisionpython/current.md) - [MedXpertQA (MM)](https://benchgap.net/b/medxpertqamm/current.md) - [MLVU (M-Avg)](https://benchgap.net/b/mlvuavg/current.md) - [MMMU](https://benchgap.net/b/mmmu/current.md) - [MMMU-Pro](https://benchgap.net/b/mmmu-pro/current.md) - [MMMU-Pro w/ Python](https://benchgap.net/b/mmmupropython/current.md) - [MMVU](https://benchgap.net/b/mmvu/current.md) - [OCRBench V2](https://benchgap.net/b/ocrbenchv2/current.md) - [OfficeQA Pro](https://benchgap.net/b/officeqapro/current.md) - [OmniDocBench 1.5](https://benchgap.net/b/omnidocbench15/current.md) - [ParseBench](https://benchgap.net/b/parsebench/current.md) - [RealWorldQA](https://benchgap.net/b/realworldqa/current.md) - [RefCOCO (avg)](https://benchgap.net/b/refcocoavg/current.md) - [ScreenSpot Pro](https://benchgap.net/b/screenspot-pro/current.md) - [SimpleVQA](https://benchgap.net/b/simplevqa/current.md) - [SWE-bench Multimodal](https://benchgap.net/b/swe-bench-multimodal/current.md) - [Video-MME (w/o subtitle)](https://benchgap.net/b/videommenosub/current.md) - [Video-MME (with subtitle)](https://benchgap.net/b/videommewithsub/current.md) - [VideoMMMU](https://benchgap.net/b/videommmu/current.md) - [V*](https://benchgap.net/b/vstar/current.md) - [We-Math](https://benchgap.net/b/wemath/current.md) - [ZeroBench](https://benchgap.net/b/zerobench/current.md) ### Long context - [AA-LCR](https://benchgap.net/b/lcr/current.md) - [LongBench v2](https://benchgap.net/b/longbench-v2/current.md) - [MMLongBench-Doc](https://benchgap.net/b/mmlongbenchdoc/current.md) - [MRCRv2](https://benchgap.net/b/mrcrv2/current.md) ### General - [HLE-MultiChoice (Decision Index)](https://benchgap.net/b/aa-decision-hle-multi-choice/current.md) - [Artificial Analysis Decision Index](https://benchgap.net/b/aa-decision-index/current.md) - [When2Call (Decision Index)](https://benchgap.net/b/aa-decision-when2-call/current.md) - [WildGuardTest (Decision Index)](https://benchgap.net/b/aa-decision-wild-guard-test/current.md) - [Decision Index Full Score](https://benchgap.net/b/decisionindex/current.md) - [ExploitBench](https://benchgap.net/b/exploitbench/current.md) - [Decision Index Arts](https://benchgap.net/b/jevdecisionindex03arts/current.md) - [Decision Index Knowledge](https://benchgap.net/b/jevdecisionindex03knowledge/current.md) - [Decision Index Language](https://benchgap.net/b/jevdecisionindex03language/current.md) - [Decision Index Retrieval](https://benchgap.net/b/jevdecisionindex03retrieval/current.md) - [Decision Index Tools](https://benchgap.net/b/jevdecisionindex03tools/current.md) - [SEC-Bench Pro](https://benchgap.net/b/secbenchpro/current.md)