benchgap
Long context

AA-LCR leaderboard

As of 2026-11-21, the highest measured score on AA-LCR is 88.7% by Kimi K3. 12 more models have estimated scores, calibrated from the benchmarks they were measured on.

Measured scores: benchlm.ai.

#ModelScoreSource
1Kimi K388.7%measured
2Step 5 Preview88.3%measured
3Kimi K3.1 Pro86.3%measured
4MiMo-V2.6-Pro86.3%measured
5Claude Fable 5.185.3%measured
6Claude Opus 5.584.7%measured
7GPT-5.584.3%measured
8DeepSeek V4.1 Flash 101784.0%measured
9GPT-5.6 Sol84.0%measured
10GPT-5.6 Luna83.7%measured
11GPT-6 Sol83.7%measured
12Muse Wonder Full83.7%measured
13Claude Fable 5.283.3%measured
14GPT-5.3 Codex83.3%measured
15GPT-6 Luna83.3%measured
16Inkling 2 Small83.3%measured
17Muse Glimmer 30B83.3%measured
18GPT-5.6 Terra83.0%measured
19GPT-6.1 Sol83.0%measured
20Ling 3.1 Flash83.0%measured
21MiniMax M383.0%measured
22Muse Spark 1.383.0%measured
23Claude Haiku 5.582.7%measured
24Claude Sonnet 5.582.7%measured
25GPT-5.282.7%measured
26GPT-6.1 Terra82.7%measured
27Claude Fable 582.3%measured
28GPT-5.2-Codex82.3%measured
29Claude Sonnet 582.0%measured
30Gemini 3.1 Pro82.0%measured
31GPT-5.482.0%measured
32Qwen3.8-27B82.0%measured
33Gemini 3.7 Flash81.7%measured
34Gemini 3.8 Flash81.3%measured
35Kimi K2.681.0%measured
36Sage-A1.581.0%measured
37GPT-6 Astra80.7%measured
38Muse Wonder80.7%measured
39Qwen 3.6 Max (preview)80.7%measured
40DeepSeek V4 Pro80.3%measured
41Grok 4.680.3%measured
42Qwen3.8 Max Preview80.3%measured
43Gemini 3.6 Flash80.0%measured
44GPT-5.180.0%measured
45DeepSeek V4 Flash 073179.7%measured
46Gemini 4 Argon79.7%measured
47GLM-5.379.7%measured
48MiMo-V2.5-Pro79.7%measured
49MiniMax M3.1 Flash79.7%measured
50Qwen3.8-Flash-Next79.7%measured
51Inkling 2 Mini79.5%estimated ± 12.5 pp, low confidence
52Beam 1.0 501B-A23B FP879.4%measured
53Apodex 1.179.3%measured
54Apodex 1.1 Mini79.3%measured
55Claude Opus 579.3%measured
56Gemini 4 Carbon79.3%measured
57Grok 4.579.3%measured
58Kimi K2.7 Code79.3%measured
59Hy379.0%measured
60Muse Spark 1.279.0%measured
61Qwen3.7 Max79.0%measured
62Claude Opus 4.778.7%measured
63Beam 1.0 501B-A23B NVFP478.7%measured
64GLM-5.278.3%measured
65Ling 3.0 Flash VL78.3%measured
66MiniMax M2.778.3%measured
67Muse Spark Open78.3%measured
68Qwen3.6 Plus78.3%measured
69GPT-578.2%measured
70Beam 1.0 501B-A23B78.2%measured
71Claude Opus 4.6 (Adaptive)78.0%measured
72Kimi K2.578.0%measured
73Muse Spark78.0%measured
74Claude Opus 4.877.7%measured
75Muse Spark 1.177.7%measured
76Qwen3.5-27B77.7%measured
77Claude Opus 4.5 Thinking77.3%measured
78Inkling77.3%measured
79Qwen3.5 397B77.3%measured
80Qwen3.6-27B77.3%measured
81GPT-5.4 mini77.0%measured
82Ternary Bonsai 2 27B77.0%measured
83GPT-5.4 nano76.7%measured
84Grok 4.776.7%measured
85Quasar 438B76.3%measured
86Qwen3.5-122B-A10B76.3%measured
87Gemini 3.5 Flash-Lite76.0%measured
88Gemini 3 Pro76.0%measured
89GLM-575.7%measured
90Inkling-Small75.7%measured
91MiMo-V2-Omni75.0%measured
92Ripple-65B Preview75.0%measured
93o374.7%measured
94Sakana Fugu-Ultra74.3%estimated ± 3.4 pp, medium confidence
95MiMo-V2.6-Flash74.3%measured
96Qwen3.8 Max74.3%estimated ± 3.4 pp, medium confidence
97Sakana Fugu74.1%estimated ± 3.4 pp, high confidence
98Grok 4.1 Fast (Reasoning)74.0%measured
99GLM-5.173.7%measured
100Grok 4 Fast (Reasoning)73.7%measured
101Step 3.7 Flash73.7%measured
102Mercury 373.5%estimated ± 3.4 pp, high confidence
103Ling 3.0 Flash73.0%measured
104Qwen3.7 Plus73.0%measured
105Qwen3.5-35B-A3B72.0%measured
106GLM-5-Turbo71.7%measured
107Qwen3.6-35B-A3B71.7%measured
108Pokee-Isaac 28B71.6%estimated ± 3.4 pp, high confidence
109GLM-4.771.0%measured
110Solar Pro 471.0%measured
111Claude Opus 4.570.7%measured
112Ling 3.0 Flash Sante70.5%measured
113GLM-5V-Turbo70.3%measured
114MiniMax M1 80k70.3%estimated ± 12.5 pp, low confidence
115Gemma 4 31B69.7%measured
116Nemotron 3.5 Bolt 74B-A9B69.7%measured
117Claude 4 Opus Thinking69.3%measured
118Gemini 3.5 Flash69.3%measured
119GPT-5.1-Codex69.3%measured
120GPT-5.1-Codex-Max69.3%measured
121Mistral Medium 3.5 128B69.3%measured
122Gemini 2.5 Pro69.0%measured
123Nemotron 3.5 Super VL 120B A12B68.6%measured
124Claude Sonnet 4.668.3%measured
125GPT-4.168.3%measured
126MiMo-V2-Pro68.3%measured
127Agents-A168.1%estimated ± 12.5 pp, low confidence
128Grok 468.0%measured
129Mercury 2.568.0%measured
130Nemotron 3.5 Super VL 120B A12B NVFP467.7%measured
131Nemotron 3.5 Bolt 74B-A9B BF1667.4%measured
132Spark-X2.6-4B67.3%measured
133Claude Opus 4.667.0%measured
134Nemotron 3 Ultra67.0%measured
135Hy3 Preview66.7%measured
136A.X K266.0%measured
137Gemma 4 26B A4B65.7%measured
138o165.0%measured
139Grok 4.364.3%measured
140Gemma 4 12B63.7%measured
141Qwen3.5-4B63.0%measured
142Solar Open 262.3%measured
143K-Exaone61.3%measured
144o4-mini61.0%measured
145Ling 3.0 Tiny60.3%measured
146MiniCPM5-2B59.0%measured
147K-EXAONE 2.056.2%measured
148Agents-A1-4B55.7%estimated ± 12.5 pp, low confidence
149DeepSeek-R155.7%measured
150Gemini 3 Flash55.3%measured
151Nemotron 3.5 Bolt E4B BF1653.5%estimated ± 12.5 pp, low confidence
152Grok Code Fast 153.0%measured
153Kimi K253.0%measured
154LFM3-1.7B52.8%measured
155Command A+52.7%measured
156GPT-OSS 120B52.0%measured
157Claude 3.7 Sonnet51.7%measured
158Nemotron 3.5 Bolt E4B50.9%estimated ± 12.5 pp, low confidence
159Llama 4 Maverick50.0%measured
160Qwen3 Max50.0%measured
161Gemini 2.5 Flash49.9%measured
162Mistral Small 449.7%measured
163GPT-4o49.3%measured
164Nemotron 3.5 Lightning 30B A3B NVFP449.2%measured
165Granite 4.2 30B49.0%measured
166DeepSeek V3.147.0%measured
167GLM-4.5-Air46.7%measured
168DeepSeek V3.245.7%measured
169Granite 4.2 8B45.0%measured
170Claude 4 Sonnet44.0%measured
171GPT-4.1 mini44.0%measured
172DeepSeek V3 032440.7%measured
173Nemotron 3 Nano Omni 30B A3B39.7%measured
174Celeris-138.0%measured
175Trinity-Large-Preview38.0%measured
176Trinity-Large-Thinking38.0%measured
177North Mini Code37.3%measured
178MiMo-V2-Flash36.3%measured
179Mistral Large 336.0%measured
180GPT-OSS 20B34.7%measured
181LLaDA2.2-mini33.6%estimated ± 12.5 pp, low confidence
182Solar Pro 332.3%measured
183Gemini 2.5 Flash-Lite32.0%measured
184Gemma 4 E4B32.0%measured
185Gemini 2.0 Flash31.3%measured
186Grok 4.1 Fast31.3%measured
187Ling 2.6 Flash31.3%measured
188Mistral Medium 331.3%measured
189DeepSeek V329.3%measured
190Claude 3 Haiku27.7%measured
191Llama 4 Scout27.7%measured
192Claude 3.5 Haiku27.3%measured
193QwQ-32B26.7%measured
194GLM-4.626.3%measured
195Llama 3.1 405B25.3%measured
196Granite 4.2 3B24.3%measured
197Mistral Small 3.122.3%measured
198Nova Pro21.0%measured
199GPT-4.1 nano20.3%measured
200Devstral Small18.7%measured
201Gemma 4 E2B16.3%measured
202Llama 3.3 70B15.7%measured
203Ultravox v0.6 Llama 3.3 70B15.7%measured
204Nemotron 3 Nano 30B10.7%measured
205DeepSeek R1 Distill Qwen 32B8.7%measured
206Gemma 3 27B7.3%measured
207Granite-4.0-H-1B7.0%measured
208LFM2.5-2.6B5.7%measured
209Llama 3.1 70B4.7%measured
210Exaone 4.0 1.2B0.0%measured
211Granite-4.0-350M0.0%measured
212Granite-4.0-H-350M0.0%measured
213LFM2.5-8B-A1B0.0%measured
214LFM2.5-VL-1.6B-Extract0.0%measured
215Magistral Medium0.0%measured
216Magistral Small0.0%measured
217Phi-40.0%measured
218Phi-4-reasoning0.0%measured
219Qwen3-Omni-30B-A3B-Instruct0.0%measured
220Qwen3-Omni-30B-A3B-Thinking0.0%measured
221Sarvam 105B0.0%measured
222Sarvam 30B0.0%measured
223Solar Pro 20.0%measured

All leaderboards

Agentic · terminal

Agentic · tools

Coding

Math

Knowledge & reasoning

Instruction following

Multilingual

Vision & documents

Long context

General