benchgap
Long context

LongBench v2 leaderboard

As of 2026-11-21, the highest measured score on LongBench v2 is 70.6% by Inkling 2 Small. 194 more models have estimated scores, calibrated from the benchmarks they were measured on.

Measured scores: benchlm.ai.

#ModelScoreSource
1Kimi K374.0%estimated ± 5.5 pp, low confidence
2Step 5 Preview73.6%estimated ± 5.5 pp, low confidence
3Kimi K3.1 Pro71.5%estimated ± 5.5 pp, low confidence
4MiMo-V2.6-Pro71.5%estimated ± 5.5 pp, low confidence
5Inkling 2 Small70.6%measured
6Claude Fable 5.170.6%estimated ± 5.5 pp, low confidence
7Claude Opus 5.570.0%estimated ± 5.5 pp, low confidence
8GPT-5.569.6%estimated ± 5.5 pp, low confidence
9DeepSeek V4.1 Flash 101769.3%estimated ± 5.5 pp, low confidence
10GPT-5.6 Sol69.3%estimated ± 5.5 pp, low confidence
11GPT-5.6 Luna69.0%estimated ± 5.5 pp, low confidence
12GPT-6 Sol69.0%estimated ± 5.5 pp, low confidence
13Muse Wonder Full69.0%estimated ± 5.5 pp, low confidence
14Claude Fable 5.268.6%estimated ± 5.5 pp, medium confidence
15GPT-5.3 Codex68.6%estimated ± 5.5 pp, medium confidence
16GPT-6 Luna68.6%estimated ± 5.5 pp, medium confidence
17Muse Glimmer 30B68.6%estimated ± 5.5 pp, medium confidence
18GPT-5.6 Terra68.4%estimated ± 5.5 pp, medium confidence
19GPT-6.1 Sol68.4%estimated ± 5.5 pp, medium confidence
20Ling 3.1 Flash68.4%estimated ± 5.5 pp, medium confidence
21MiniMax M368.4%estimated ± 5.5 pp, medium confidence
22Muse Spark 1.368.4%estimated ± 5.5 pp, medium confidence
23Claude Haiku 5.568.1%estimated ± 5.5 pp, medium confidence
24Claude Sonnet 5.568.1%estimated ± 5.5 pp, medium confidence
25GPT-5.268.1%estimated ± 5.5 pp, medium confidence
26GPT-6.1 Terra68.1%estimated ± 5.5 pp, medium confidence
27Claude Fable 567.7%estimated ± 5.5 pp, medium confidence
28GPT-5.2-Codex67.7%estimated ± 5.5 pp, medium confidence
29Beam 1.0 501B-A23B FP867.6%measured
30Beam 1.0 501B-A23B67.5%measured
31Claude Sonnet 567.4%estimated ± 5.5 pp, medium confidence
32Gemini 3.1 Pro67.4%estimated ± 5.5 pp, medium confidence
33GPT-5.467.4%estimated ± 5.5 pp, medium confidence
34Qwen3.8-27B67.4%estimated ± 5.5 pp, medium confidence
35Beam 1.0 501B-A23B NVFP467.2%measured
36Gemini 3.7 Flash67.2%estimated ± 5.5 pp, medium confidence
37Inkling 2 Mini66.9%measured
38Gemini 3.8 Flash66.8%estimated ± 5.5 pp, medium confidence
39Kimi K2.666.5%estimated ± 5.5 pp, medium confidence
40Sage-A1.566.5%estimated ± 5.5 pp, medium confidence
41Qwen3.8 Max66.3%measured
42GPT-6 Astra66.3%estimated ± 5.5 pp, medium confidence
43Muse Wonder66.3%estimated ± 5.5 pp, medium confidence
44Qwen 3.6 Max (preview)66.3%estimated ± 5.5 pp, medium confidence
45DeepSeek V4 Pro65.9%estimated ± 5.5 pp, medium confidence
46Grok 4.665.9%estimated ± 5.5 pp, medium confidence
47Qwen3.8 Max Preview65.9%estimated ± 5.5 pp, medium confidence
48Gemini 3.6 Flash65.7%estimated ± 5.5 pp, medium confidence
49GPT-5.165.7%estimated ± 5.5 pp, medium confidence
50DeepSeek V4 Flash 073165.4%estimated ± 5.5 pp, medium confidence
51Gemini 4 Argon65.4%estimated ± 5.5 pp, medium confidence
52GLM-5.365.4%estimated ± 5.5 pp, medium confidence
53MiMo-V2.5-Pro65.4%estimated ± 5.5 pp, medium confidence
54MiniMax M3.1 Flash65.4%estimated ± 5.5 pp, medium confidence
55Qwen3.8-Flash-Next65.4%estimated ± 5.5 pp, medium confidence
56Apodex 1.165.1%estimated ± 5.5 pp, medium confidence
57Apodex 1.1 Mini65.1%estimated ± 5.5 pp, medium confidence
58Claude Opus 565.1%estimated ± 5.5 pp, medium confidence
59Gemini 4 Carbon65.1%estimated ± 5.5 pp, medium confidence
60Grok 4.565.1%estimated ± 5.5 pp, medium confidence
61Kimi K2.7 Code65.1%estimated ± 5.5 pp, medium confidence
62Hy364.8%estimated ± 5.5 pp, medium confidence
63Muse Spark 1.264.8%estimated ± 5.5 pp, medium confidence
64Qwen3.7 Max64.8%estimated ± 5.5 pp, medium confidence
65Claude Opus 4.764.6%estimated ± 5.5 pp, medium confidence
66Claude Opus 4.564.4%measured
67GLM-5.264.2%estimated ± 5.5 pp, medium confidence
68Ling 3.0 Flash VL64.2%estimated ± 5.5 pp, medium confidence
69MiniMax M2.764.2%estimated ± 5.5 pp, medium confidence
70Muse Spark Open64.2%estimated ± 5.5 pp, medium confidence
71GPT-564.2%estimated ± 5.5 pp, medium confidence
72Claude Opus 4.6 (Adaptive)64.0%estimated ± 5.5 pp, medium confidence
73Muse Spark64.0%estimated ± 5.5 pp, medium confidence
74Claude Opus 4.863.8%estimated ± 5.5 pp, medium confidence
75Muse Spark 1.163.8%estimated ± 5.5 pp, medium confidence
76Claude Opus 4.5 Thinking63.4%estimated ± 5.5 pp, medium confidence
77Inkling63.4%estimated ± 5.5 pp, medium confidence
78Qwen3.6-27B63.4%estimated ± 5.5 pp, medium confidence
79GPT-5.4 mini63.2%estimated ± 5.5 pp, medium confidence
80Ternary Bonsai 2 27B63.2%estimated ± 5.5 pp, medium confidence
81Qwen3.5 397B63.2%measured
82GPT-5.4 nano63.0%estimated ± 5.5 pp, medium confidence
83Grok 4.763.0%estimated ± 5.5 pp, medium confidence
84Quasar 438B62.7%estimated ± 5.5 pp, medium confidence
85Gemini 3.5 Flash-Lite62.5%estimated ± 5.5 pp, medium confidence
86Gemini 3 Pro62.5%estimated ± 5.5 pp, medium confidence
87Inkling-Small62.2%estimated ± 5.5 pp, medium confidence
88Qwen3.6 Plus62.0%measured
89Nemotron 3 Ultra61.9%measured
90MiMo-V2-Omni61.7%estimated ± 5.5 pp, medium confidence
91Ripple-65B Preview61.7%estimated ± 5.5 pp, medium confidence
92o361.5%estimated ± 5.5 pp, medium confidence
93MiniMax M1 80k61.5%measured
94MiMo-V2.6-Flash61.2%estimated ± 5.5 pp, medium confidence
95Grok 4.1 Fast (Reasoning)61.0%estimated ± 5.5 pp, medium confidence
96Kimi K2.561.0%measured
97GLM-5.160.8%estimated ± 5.5 pp, medium confidence
98Grok 4 Fast (Reasoning)60.8%estimated ± 5.5 pp, medium confidence
99Step 3.7 Flash60.8%estimated ± 5.5 pp, medium confidence
100GLM-560.8%measured
101MiMo-V2-Flash60.6%measured
102Qwen3.5-27B60.6%measured
103Ling 3.0 Flash60.4%estimated ± 5.5 pp, medium confidence
104Qwen3.7 Plus60.4%estimated ± 5.5 pp, medium confidence
105Agents-A160.2%measured
106Qwen3.5-122B-A10B60.2%measured
107GLM-5-Turbo59.5%estimated ± 5.5 pp, medium confidence
108Qwen3.6-35B-A3B59.5%estimated ± 5.5 pp, medium confidence
109GLM-4.759.1%estimated ± 5.5 pp, medium confidence
110Solar Pro 459.1%estimated ± 5.5 pp, medium confidence
111Qwen3.5-35B-A3B59.0%measured
112Ling 3.0 Flash Sante58.8%estimated ± 5.5 pp, medium confidence
113GLM-5V-Turbo58.7%estimated ± 5.5 pp, medium confidence
114Gemma 4 31B58.4%estimated ± 5.5 pp, medium confidence
115Nemotron 3.5 Bolt 74B-A9B58.4%estimated ± 5.5 pp, medium confidence
116Claude 4 Opus Thinking58.1%estimated ± 5.5 pp, medium confidence
117Gemini 3.5 Flash58.1%estimated ± 5.5 pp, medium confidence
118GPT-5.1-Codex58.1%estimated ± 5.5 pp, medium confidence
119GPT-5.1-Codex-Max58.1%estimated ± 5.5 pp, medium confidence
120Mistral Medium 3.5 128B58.1%estimated ± 5.5 pp, medium confidence
121Gemini 2.5 Pro58.0%estimated ± 5.5 pp, medium confidence
122Nemotron 3.5 Super VL 120B A12B57.8%estimated ± 5.5 pp, medium confidence
123Claude Sonnet 4.657.6%estimated ± 5.5 pp, medium confidence
124GPT-4.157.6%estimated ± 5.5 pp, medium confidence
125MiMo-V2-Pro57.6%estimated ± 5.5 pp, medium confidence
126Grok 457.5%estimated ± 5.5 pp, medium confidence
127Mercury 2.557.5%estimated ± 5.5 pp, medium confidence
128Nemotron 3.5 Super VL 120B A12B NVFP457.3%estimated ± 5.5 pp, medium confidence
129Nemotron 3.5 Bolt 74B-A9B BF1657.2%estimated ± 5.5 pp, medium confidence
130Claude Opus 4.657.0%estimated ± 5.5 pp, medium confidence
131Hy3 Preview56.8%estimated ± 5.5 pp, medium confidence
132A.X K256.5%estimated ± 5.5 pp, medium confidence
133Gemma 4 26B A4B56.4%estimated ± 5.5 pp, medium confidence
134o156.1%estimated ± 5.5 pp, medium confidence
135Grok 4.355.8%estimated ± 5.5 pp, medium confidence
136Gemma 4 12B55.6%estimated ± 5.5 pp, medium confidence
137Qwen3.5-4B55.3%estimated ± 5.5 pp, medium confidence
138Solar Open 255.0%estimated ± 5.5 pp, medium confidence
139K-Exaone54.7%estimated ± 5.5 pp, medium confidence
140o4-mini54.6%estimated ± 5.5 pp, medium confidence
141Ling 3.0 Tiny54.4%estimated ± 5.5 pp, medium confidence
142K-EXAONE 2.053.3%estimated ± 5.5 pp, medium confidence
143Spark-X2.6-4B53.3%measured
144DeepSeek-R153.2%estimated ± 5.5 pp, medium confidence
145Gemini 3 Flash53.1%estimated ± 5.5 pp, medium confidence
146Grok Code Fast 152.7%estimated ± 5.5 pp, medium confidence
147Kimi K252.7%estimated ± 5.5 pp, medium confidence
148LFM3-1.7B52.7%estimated ± 5.5 pp, medium confidence
149Command A+52.6%estimated ± 5.5 pp, medium confidence
150GPT-OSS 120B52.5%estimated ± 5.5 pp, medium confidence
151Claude 3.7 Sonnet52.5%estimated ± 5.5 pp, medium confidence
152Llama 4 Maverick52.2%estimated ± 5.5 pp, medium confidence
153Qwen3 Max52.2%estimated ± 5.5 pp, medium confidence
154Gemini 2.5 Flash52.2%estimated ± 5.5 pp, medium confidence
155Mistral Small 452.2%estimated ± 5.5 pp, medium confidence
156GPT-4o52.2%estimated ± 5.5 pp, medium confidence
157Nemotron 3.5 Lightning 30B A3B NVFP452.1%estimated ± 5.5 pp, medium confidence
158Granite 4.2 30B52.1%estimated ± 5.5 pp, medium confidence
159Agents-A1-4B52.1%measured
160DeepSeek V3.151.9%estimated ± 5.5 pp, medium confidence
161GLM-4.5-Air51.9%estimated ± 5.5 pp, medium confidence
162DeepSeek V3.251.8%estimated ± 5.5 pp, medium confidence
163Granite 4.2 8B51.7%estimated ± 5.5 pp, medium confidence
164Claude 4 Sonnet51.7%estimated ± 5.5 pp, medium confidence
165GPT-4.1 mini51.7%estimated ± 5.5 pp, medium confidence
166DeepSeek V3 032451.5%estimated ± 5.5 pp, medium confidence
167Nemotron 3 Nano Omni 30B A3B51.4%estimated ± 5.5 pp, medium confidence
168Celeris-151.4%estimated ± 5.5 pp, medium confidence
169Trinity-Large-Preview51.4%estimated ± 5.5 pp, medium confidence
170Trinity-Large-Thinking51.4%estimated ± 5.5 pp, medium confidence
171North Mini Code51.4%estimated ± 5.5 pp, medium confidence
172Mistral Large 351.3%estimated ± 5.5 pp, medium confidence
173GPT-OSS 20B51.3%estimated ± 5.5 pp, medium confidence
174Solar Pro 351.3%estimated ± 5.5 pp, medium confidence
175Gemini 2.5 Flash-Lite51.2%estimated ± 5.5 pp, medium confidence
176Gemma 4 E4B51.2%estimated ± 5.5 pp, medium confidence
177Gemini 2.0 Flash51.2%estimated ± 5.5 pp, medium confidence
178Grok 4.1 Fast51.2%estimated ± 5.5 pp, medium confidence
179Ling 2.6 Flash51.2%estimated ± 5.5 pp, medium confidence
180Mistral Medium 351.2%estimated ± 5.5 pp, medium confidence
181Claude 3 Haiku51.2%estimated ± 5.5 pp, low confidence
182Llama 4 Scout51.2%estimated ± 5.5 pp, low confidence
183Claude 3.5 Haiku51.2%estimated ± 5.5 pp, low confidence
184QwQ-32B51.2%estimated ± 5.5 pp, low confidence
185GLM-4.651.2%estimated ± 5.5 pp, low confidence
186Llama 3.1 405B51.2%estimated ± 5.5 pp, low confidence
187Granite 4.2 3B51.2%estimated ± 5.5 pp, low confidence
188Mistral Small 3.151.2%estimated ± 5.5 pp, low confidence
189Nova Pro51.2%estimated ± 5.5 pp, low confidence
190GPT-4.1 nano51.2%estimated ± 5.5 pp, low confidence
191Devstral Small51.2%estimated ± 5.5 pp, low confidence
192Gemma 4 E2B51.2%estimated ± 5.5 pp, low confidence
193Llama 3.3 70B51.2%estimated ± 5.5 pp, low confidence
194Ultravox v0.6 Llama 3.3 70B51.2%estimated ± 5.5 pp, low confidence
195Nemotron 3 Nano 30B51.2%estimated ± 5.5 pp, low confidence
196DeepSeek R1 Distill Qwen 32B51.2%estimated ± 5.5 pp, low confidence
197Gemma 3 27B51.2%estimated ± 5.5 pp, low confidence
198Granite-4.0-H-1B51.2%estimated ± 5.5 pp, low confidence
199LFM2.5-2.6B51.2%estimated ± 5.5 pp, low confidence
200Llama 3.1 70B51.2%estimated ± 5.5 pp, low confidence
201Exaone 4.0 1.2B51.2%estimated ± 5.5 pp, low confidence
202Granite-4.0-350M51.2%estimated ± 5.5 pp, low confidence
203Granite-4.0-H-350M51.2%estimated ± 5.5 pp, low confidence
204LFM2.5-8B-A1B51.2%estimated ± 5.5 pp, low confidence
205LFM2.5-VL-1.6B-Extract51.2%estimated ± 5.5 pp, low confidence
206Magistral Medium51.2%estimated ± 5.5 pp, low confidence
207Magistral Small51.2%estimated ± 5.5 pp, low confidence
208Phi-451.2%estimated ± 5.5 pp, low confidence
209Phi-4-reasoning51.2%estimated ± 5.5 pp, low confidence
210Qwen3-Omni-30B-A3B-Instruct51.2%estimated ± 5.5 pp, low confidence
211Qwen3-Omni-30B-A3B-Thinking51.2%estimated ± 5.5 pp, low confidence
212Sarvam 105B51.2%estimated ± 5.5 pp, low confidence
213Sarvam 30B51.2%estimated ± 5.5 pp, low confidence
214Solar Pro 251.2%estimated ± 5.5 pp, low confidence
215Nemotron 3.5 Bolt E4B BF1650.5%measured
216DeepSeek V348.7%measured
217Nemotron 3.5 Bolt E4B48.7%measured
218MiniCPM5-2B43.7%measured
219LLaDA2.2-mini35.0%measured

All leaderboards

Agentic · terminal

Agentic · tools

Coding

Math

Knowledge & reasoning

Instruction following

Multilingual

Vision & documents

Long context

General