benchgap
Knowledge & reasoning

AA-GPQA Diamond leaderboard

As of 2026-11-21, the highest measured score on AA-GPQA Diamond is 96.1% by GPT-6 Astra. 123 more models have estimated scores, calibrated from the benchmarks they were measured on.

Measured scores: benchlm.ai.

#ModelScoreSource
1Gemini 4 Argon96.6%estimated ± 1.2 pp, low confidence
2Claude Sonnet 5.596.2%estimated ± 2.1 pp, low confidence
3GPT-6.2 Astra96.2%estimated ± 2.1 pp, low confidence
4GPT-6.2 Sol96.2%estimated ± 2.1 pp, low confidence
5Claude Opus 5.596.2%estimated ± 2.1 pp, low confidence
6Ling 3.1 Flash96.2%estimated ± 2.1 pp, low confidence
7GPT-6.1 Terra96.1%estimated ± 2.1 pp, medium confidence
8GPT-6 Astra96.1%measured
9Muse Wonder Full96.1%estimated ± 2.1 pp, medium confidence
10GPT-6.1 Sol96.0%estimated ± 1.1 pp, medium confidence
11Gemini 3.8 Flash95.3%measured
12Claude Fable 5.295.3%estimated ± 2.7 pp, medium confidence
13Grok 4.694.9%measured
14GPT-6 Sol94.6%estimated ± 2.1 pp, medium confidence
15Gemini 3.7 Flash94.5%measured
16Gemini 4 Carbon94.5%estimated ± 2.7 pp, high confidence
17Gemini 4 Neon94.4%estimated ± 10.3 pp, low confidence
18Gemini 3.1 Pro94.1%measured
19GPT-5.6 Sol94.1%measured
20Muse Wonder93.9%estimated ± 2.1 pp, medium confidence
21Claude Fable 5.193.7%measured
22Claude Mythos 593.6%estimated ± 2.7 pp, high confidence
23GPT-5.5 Pro93.6%estimated ± 2.7 pp, high confidence
24GPT-5.593.5%measured
25Kimi K393.5%measured
26Muse Spark 1.393.5%measured
27GPT-5.4 Pro93.4%estimated ± 2.7 pp, high confidence
28Inkling 2 Small93.3%estimated ± 2.7 pp, high confidence
29dots3-note Preview93.2%estimated ± 2.7 pp, high confidence
30Claude Opus 593.2%measured
31Step 5 Preview93.2%estimated ± 4.4 pp, high confidence
32Grok 4.593.1%measured
33MiniMax M392.9%measured
34GPT-6 Luna92.8%estimated ± 1.1 pp, medium confidence
35Qwen4 Max92.8%estimated ± 2.1 pp, medium confidence
36DeepSeek V4 Pro92.8%measured
37Gemini 3.6 Flash92.8%measured
38Qwen3.8 Max Preview92.8%measured
39Claude Fable 592.6%measured
40GPT-5.6 Terra92.5%measured
41Kimi K3.1 Pro92.4%estimated ± 2.7 pp, high confidence
42Qwen3.7 Max92.3%measured
43Qwen3.8-Flash-Next92.3%measured
44Sage-A1.592.2%estimated ± 9.3 pp, medium confidence
45Gemini 3.5 Flash92.2%measured
46Sakana Fugu-Ultra92.2%estimated ± 2.7 pp, high confidence
47Pareto 26.10 Preview92.0%estimated ± 4.4 pp, high confidence
48Pareto 26.992.0%estimated ± 2.7 pp, high confidence
49Claude Opus 4.892.0%measured
50GPT-5.492.0%measured
51MiMo-V2.6-Pro91.8%estimated ± 9.2 pp, medium confidence
52Gemini 4 Hydrogen91.7%estimated ± 10.3 pp, low confidence
53GLM-5.391.7%measured
54Sakana Fugu91.7%estimated ± 2.7 pp, high confidence
55ERNIE 5.5 Flash Preview91.5%estimated ± 2.7 pp, high confidence
56GPT-5.3 Codex91.5%measured
57Grok 4.791.5%estimated ± 2.1 pp, medium confidence
58Ling 3.0 Flash Sante91.5%estimated ± 2.1 pp, medium confidence
59Claude Opus 4.791.4%measured
60Ornith-1.5-397B91.2%estimated ± 2.7 pp, high confidence
61Claude Sonnet 591.1%measured
62GPT-5.6 Luna91.1%measured
63Kimi K2.691.1%measured
64Qwen3.8 Max91.0%estimated ± 2.7 pp, high confidence
65Hy4 preview90.9%estimated ± 2.7 pp, high confidence
66MiniMax M3.1 Flash90.9%estimated ± 2.7 pp, high confidence
67Claude Haiku 5.590.9%estimated ± 2.7 pp, high confidence
68DeepSeek V4 Flash 073190.8%measured
69Gemini 3 Pro90.8%measured
70Qwen3.8-Omni-Flash90.5%estimated ± 4.4 pp, high confidence
71Qwen3.8-27B90.5%measured
72DeepSeek V4.1 Flash 101790.4%estimated ± 4.4 pp, high confidence
73Muse Spark 1.290.4%measured
74GPT-5.290.3%measured
75Grok 4.390.1%measured
76Grok 4.2090.0%estimated ± 2.7 pp, high confidence
77Qwen3.7 Plus90.0%measured
78Particle-189.9%estimated ± 4.4 pp, high confidence
79GPT-5.2-Codex89.9%measured
80Mistral Large 489.9%estimated ± 9.3 pp, medium confidence
81Muse Spark 1.189.8%measured
82MiMo-V2.6-Flash89.7%estimated ± 9.2 pp, medium confidence
83Hy389.7%measured
84Hy3 Preview89.7%measured
85Claude Opus 4.6 (Adaptive)89.6%measured
86Kimi K2.7 Code89.6%measured
87GLM-5.289.5%measured
88Inkling-Small89.5%measured
89Interfaze Beta89.4%estimated ± 4.4 pp, high confidence
90Qwen3.5 397B89.3%measured
91Beam 1.0 501B-A23B89.2%estimated ± 2.7 pp, high confidence
92Beam 1.0 501B-A23B FP889.2%estimated ± 2.7 pp, high confidence
93Solar Pro 489.1%measured
94Hy489.1%estimated ± 7.1 pp, medium confidence
95Hy4 flash89.1%estimated ± 7.1 pp, medium confidence
96Agents-A189.1%estimated ± 7.1 pp, medium confidence
97Muse Spark Open89.0%measured
98Beam 1.0 501B-A23B NVFP488.9%estimated ± 2.7 pp, high confidence
99Qwen 3.6 Max (preview)88.8%measured
100Mercury 388.6%estimated ± 4.4 pp, high confidence
101Muse Spark88.4%measured
102Qwen3.6 Plus88.2%measured
103Nemotron 3.5 Super VL 120B A12B88.1%estimated ± 2.7 pp, high confidence
104Nemotron 3.5 Super VL 120B A12B NVFP488.0%estimated ± 2.7 pp, high confidence
105Kimi K2.587.9%measured
106Inkling 2 Mini87.8%estimated ± 2.7 pp, high confidence
107Grok 487.7%measured
108OrcaCyber-Nano-1.087.6%estimated ± 4.4 pp, high confidence
109GPT-5.4 mini87.5%measured
110MiniMax M2.787.4%measured
111GPT-5.187.3%measured
112Inkling87.2%measured
113Solar Open 287.2%estimated ± 2.7 pp, high confidence
114Nemotron 3.5 Bolt 74B-A9B BF1687.2%estimated ± 2.7 pp, high confidence
115MiMo-V2-Pro87.0%measured
116GLM-5.186.8%measured
117Nemotron 3 Ultra86.7%measured
118GLM-5.3-Flash86.7%estimated ± 3.6 pp, high confidence
119Claude Opus 4.5 Thinking86.6%measured
120MiMo-V2.5-Pro86.6%measured
121Apodex 1.186.4%measured
122Apodex 1.1 Mini86.4%measured
123Seed 2.1 Pro86.3%estimated ± 3.7 pp, high confidence
124Ling 3.0 Flash VL86.2%measured
125Ornith-1.5-35B-A3B86.1%estimated ± 2.7 pp, high confidence
126GPT-5.1-Codex86.0%measured
127GPT-5.1-Codex-Max86.0%measured
128Nemotron 3.5 Bolt 74B-A9B86.0%estimated ± 2.7 pp, high confidence
129GLM-4.785.9%measured
130Qwen3.5-27B85.8%measured
131Seed 2.1 Turbo85.8%estimated ± 3.7 pp, high confidence
132A.X K285.7%measured
133Gemma 4 31B85.7%measured
134Qwen3.5-122B-A10B85.7%measured
135Ling 3.0 Flash85.5%measured
136Claude Sonnet 4.5 Thinking85.5%estimated ± 2.7 pp, high confidence
137Claude Sonnet 4.585.5%estimated ± 2.7 pp, high confidence
138GPT-585.4%measured
139Grok 4.1 Fast (Reasoning)85.3%measured
140Ternary Bonsai 2 27B84.7%estimated ± 4.4 pp, high confidence
141GLM-5-Turbo84.7%measured
142Grok 4 Fast (Reasoning)84.7%measured
143o3-pro84.5%measured
144Qwen3.5-35B-A3B84.5%measured
145Gemini 2.5 Pro84.4%measured
146Qwen3.6-27B84.2%measured
147Qwen3.6-35B-A3B84.1%measured
148Ripple-65B Preview84.1%estimated ± 4.4 pp, high confidence
149Claude Opus 4.684.0%measured
150Ornith-1.5-9B83.9%estimated ± 2.7 pp, high confidence
151Gemini 3.5 Flash-Lite83.8%measured
152Qwen3.5 Flash83.6%estimated ± 3.6 pp, high confidence
153Muse Glimmer 30B83.5%measured
154Qwen3 235B 250783.1%estimated ± 3.7 pp, high confidence
155MAI-Thinking-182.9%estimated ± 4.4 pp, high confidence
156K-EXAONE 2.082.9%measured
157Spark-X2.6-4B82.9%estimated ± 2.7 pp, high confidence
158MiMo-V2-Omni82.8%measured
159o382.7%measured
160Ling 3.0 Flash FP882.7%estimated ± 4.4 pp, high confidence
161MiMo-V2.582.5%estimated ± 3.6 pp, high confidence
162Claude 4.1 Opus82.2%estimated ± 12.1 pp, low confidence
163Gemini 3.1 Flash-Lite82.1%estimated ± 3.6 pp, high confidence
164GLM-582.0%measured
165GPT-5.4 nano81.7%measured
166DeepSeek-R181.3%measured
167Gemini 3 Flash81.2%measured
168Claude Opus 4.581.0%measured
169GLM-5V-Turbo80.9%measured
170Step 3.7 Flash80.9%measured
171Claude Sonnet 4.679.9%measured
172Claude 4 Opus Thinking79.6%measured
173Gemma 4 26B A4B79.2%measured
174DeepSeek-R1-052879.0%estimated ± 6.2 pp, medium confidence
175o4-mini78.4%measured
176K-Exaone78.3%measured
177Grok 3 Mini78.3%estimated ± 6.2 pp, medium confidence
178GPT-OSS 120B78.2%measured
179Nemotron 3 Super 100B77.2%estimated ± 6.2 pp, medium confidence
180Claude 3.7 Sonnet Thinking77.2%measured
181Qwen3.5-4B77.1%measured
182o1-pro77.0%estimated ± 6.2 pp, medium confidence
183Mercury 2.577.0%estimated ± 4.4 pp, high confidence
184Mistral Small 476.9%measured
185Kimi K276.6%measured
186o1-preview76.5%measured
187Qwen3 Max76.4%measured
188Command A+76.1%measured
189North Mini Code75.7%measured
190Gemma 4 12B75.3%measured
191Trinity-Large-Preview75.2%measured
192Trinity-Large-Thinking75.2%measured
193DeepSeek V3.275.1%measured
194Mistral Medium 3.5 128B74.8%measured
195o3-mini74.8%measured
196o174.7%measured
197Claude Haiku 4.574.4%estimated ± 3.6 pp, high confidence
198GLM-4.574.4%estimated ± 3.6 pp, high confidence
199Nemotron 3.5 Lightning 30B A3B NVFP474.3%measured
200Muse Ember74.1%estimated ± 10.3 pp, low confidence
201Sarvam 105B73.8%measured
202DeepSeek V3.173.5%measured
203Ling 3.0 Tiny73.4%measured
204Grok 3 [Beta]73.4%estimated ± 6.2 pp, medium confidence
205GLM-4.5-Air73.3%measured
206Quasar 438B73.2%measured
207GLM-4.7-Flash73.2%estimated ± 6.2 pp, medium confidence
208Nemotron Ultra 253B72.8%measured
209Grok Code Fast 172.7%measured
210Qwen3-Omni-30B-A3B-Thinking72.6%measured
211Solar Pro 372.4%measured
212LFM2.5-24B-A2B72.0%estimated ± 4.4 pp, high confidence
213MiniCPM5-1B70.2%estimated ± 3.7 pp, medium confidence
214MiniCPM5-2B70.2%measured
215Claude 4 Opus70.1%measured
216Qwen3 235B-A22B (Reasoning)69.0%estimated ± 6.2 pp, medium confidence
217GPT-OSS 20B68.8%measured
218ZAYA1-8B68.6%estimated ± 4.4 pp, high confidence
219Claude 4 Sonnet68.3%measured
220Gemini 2.5 Flash68.3%measured
221Mistral Large 368.0%measured
222Magistral Medium67.9%measured
223GPT-4.567.4%estimated ± 6.2 pp, medium confidence
224LongCat-Flash-Lite-Sparse67.2%estimated ± 4.4 pp, high confidence
225Llama 4 Maverick67.1%measured
226Phi-4-reasoning-plus66.8%estimated ± 6.2 pp, medium confidence
227GPT-4.166.6%measured
228GPT-4.1 mini66.4%measured
229Qwen3 32B (Reasoning)66.3%estimated ± 6.2 pp, medium confidence
230Claude 3.7 Sonnet65.6%measured
231MiMo-V2-Flash65.6%measured
232DeepSeek V3 032465.5%measured
233Granite 4.2 30B64.4%measured
234Magistral Small64.1%measured
235Grok 4.1 Fast63.7%measured
236Sarvam 30B63.3%measured
237Claude 3.5 Sonnet63.3%estimated ± 3.6 pp, high confidence
238Mellum2.1-12B-A2.5B-Thinking63.2%estimated ± 4.4 pp, high confidence
239GLM-4.663.2%measured
240DeepSeek R1 Distill Llama 70B63.1%estimated ± 6.2 pp, medium confidence
241Celeris-163.1%measured
242Granite 4.2 8B63.1%measured
243Exaone 4.0 32B62.8%measured
244LFM3-1.7B62.4%estimated ± 4.4 pp, high confidence
245Gemini 2.0 Flash62.3%measured
246Qwen3-Omni-30B-A3B-Instruct62.0%measured
247DeepSeek R1 Distill Qwen 32B61.5%measured
248Qwen3 235B-A22B60.8%estimated ± 6.2 pp, medium confidence
249o1-mini60.3%measured
250Laguna XS.259.7%estimated ± 3.6 pp, high confidence
251Ling 2.6 Flash59.3%measured
252QwQ-32B59.3%measured
253Mellum2-12B-A2.5B-Thinking59.1%estimated ± 4.4 pp, medium confidence
254DeepSeek-R1-0528-Qwen3-8B59.0%estimated ± 6.2 pp, medium confidence
255ZAYA1-74B-Preview59.0%estimated ± 4.4 pp, medium confidence
256Gemini 1.5 Pro58.9%measured
257Llama 4 Scout58.7%measured
258Qwen2.5-Max58.0%estimated ± 6.2 pp, medium confidence
259Mistral Medium 357.8%measured
260Gemma 4 E4B57.6%measured
261Phi-457.5%measured
262Phi-4-reasoning57.5%measured
263DeepSeek R1 Distill Qwen 14B57.0%estimated ± 6.2 pp, medium confidence
264Solar Pro 256.1%measured
265Granite 4.2 3B55.9%measured
266LFM2.5-2.6B55.8%measured
267DeepSeek V355.7%measured
268LLaDA2.2-mini55.3%estimated ± 4.4 pp, medium confidence
269Soofi S 30B-A3B55.2%estimated ± 4.4 pp, medium confidence
270Mellum2-12B-A2.5B-Instruct54.9%estimated ± 4.4 pp, medium confidence
271GPT-4o54.3%measured
272Grok 253.8%estimated ± 6.2 pp, medium confidence
273Qwen3 32B52.4%estimated ± 6.2 pp, medium confidence
274MiniMax-Text-0152.2%estimated ± 6.2 pp, medium confidence
275Llama 3.1 405B51.5%measured
276LFM2.5-8B-A1B51.3%measured
277GPT-4.1 nano51.2%measured
278Nova Pro49.9%measured
279Llama 3.3 70B49.8%measured
280Ultravox v0.6 Llama 3.3 70B49.8%measured
281Llama 3.1 70B49.1%measured
282Claude 3 Opus48.9%measured
283Grok 2 mini48.8%estimated ± 6.2 pp, medium confidence
284Mistral Large 248.6%measured
285Gemini 2.0 Flash-Lite48.3%estimated ± 6.2 pp, medium confidence
286GPT-4 Turbo48.1%estimated ± 9.2 pp, medium confidence
287Gemini 2.5 Flash-Lite47.4%measured
288Nemotron 3 Nano Omni 30B A3B46.9%measured
289Gemini 1.5 Flash46.3%measured
290Mistral Small 3.145.4%measured
291Qwen2.5-VL-32B43.8%estimated ± 6.2 pp, medium confidence
292Gemma 4 E2B43.3%measured
293Gemma 3 27B42.8%measured
294GPT-4o mini42.6%measured
295Exaone 4.0 1.2B42.4%measured
296DeepSeek-V2.542.3%measured
297Qwen2.5 Coder 32B Instruct41.7%measured
298Devstral Small41.4%measured
299Claude 3.5 Haiku40.8%measured
300Nemotron 3 Nano 30B39.9%measured
301Claude 3 Haiku37.4%measured
302Mixtral 8x22B Instruct v0.136.7%estimated ± 6.9 pp, medium confidence
303Laguna M.135.4%estimated ± 3.6 pp, medium confidence
304Gemma 2 27B33.6%estimated ± 6.9 pp, medium confidence
305Phi-4 Multimodal Instruct31.5%measured
306LFM2.5-VL-1.6B-Extract28.9%measured
307LFM2.5-350M28.3%estimated ± 6.2 pp, medium confidence
308Phi-3.5-mini28.1%estimated ± 6.2 pp, medium confidence
309Gemini 1.0 Pro27.7%measured
310Granite-4.0-1B27.6%estimated ± 6.2 pp, medium confidence
311Llama 3.1 8B27.0%measured
312Granite-4.0-H-1B26.3%measured
313Granite-4.0-350M26.1%measured
314Granite-4.0-H-350M25.7%measured
315LFM2.5-VL-450M23.3%estimated ± 6.2 pp, medium confidence
316LFM2.5-230M23.1%estimated ± 6.2 pp, medium confidence

All leaderboards

Agentic · terminal

Agentic · tools

Coding

Math

Knowledge & reasoning

Instruction following

Multilingual

Vision & documents

Long context

General