benchgap
Instruction following

AA-IFBench leaderboard

As of 2026-11-22, the highest measured score on AA-IFBench is 82.9% by MiniMax M3. 66 more models have estimated scores, calibrated from the benchmarks they were measured on.

Measured scores: benchlm.ai.

#ModelScoreSource
1MiniMax M382.9%measured
2Nemotron 3 Ultra81.4%measured
3Grok 4.381.3%measured
4Qwen3.7 Max80.5%measured
5Flint80.4%estimated ± 7.4 pp, low confidence
6MAI-Thinking-180.4%estimated ± 7.4 pp, low confidence
7Qwen3.8 Max80.4%estimated ± 7.4 pp, low confidence
8Inkling-Small80.4%estimated ± 7.4 pp, low confidence
9Sage-A1.580.4%estimated ± 7.4 pp, medium confidence
10Qwen3.8-Omni-Flash80.4%estimated ± 7.4 pp, medium confidence
11Qwen3.8-Flash-Next80.4%estimated ± 7.4 pp, medium confidence
12Beam 1.0 501B-A23B FP880.4%estimated ± 7.4 pp, medium confidence
13dots3-note Preview80.4%estimated ± 7.4 pp, medium confidence
14Solar Open 280.4%estimated ± 7.4 pp, medium confidence
15Inkling80.3%estimated ± 7.4 pp, medium confidence
16Beam 1.0 501B-A23B80.3%estimated ± 7.4 pp, medium confidence
17Qwen3.8-27B80.3%estimated ± 7.4 pp, medium confidence
18Granite 4.2 8B80.3%estimated ± 7.4 pp, medium confidence
19Beam 1.0 501B-A23B NVFP480.3%estimated ± 7.4 pp, medium confidence
20Ripple-65B Preview80.3%estimated ± 7.4 pp, medium confidence
21MiMo-V2.5-Pro79.9%measured
22Agents-A179.6%estimated ± 8.8 pp, medium confidence
23Granite 4.2 30B79.3%estimated ± 7.4 pp, medium confidence
24Mercury 2.579.1%estimated ± 7.4 pp, medium confidence
25Muse Glimmer 30B79.1%estimated ± 7.4 pp, medium confidence
26Qwen3.5 397B78.8%measured
27Mercury 378.8%estimated ± 7.4 pp, medium confidence
28Qwen3.7 Plus78.0%measured
29GPT-5.2-Codex77.6%measured
30Gemini 3.1 Pro77.1%measured
31Qwen 3.6 Max (preview)76.6%measured
32DeepSeek V4 Pro76.5%measured
33Gemini 3.5 Flash76.3%measured
34GLM-5.176.3%measured
35Kimi K2.676.0%measured
36GPT-5.4 nano75.9%measured
37GPT-5.575.9%measured
38Muse Spark75.9%measured
39MiniMax M2.775.7%measured
40Qwen3.5-122B-A10B75.7%measured
41Gemma 4 31B75.6%measured
42Qwen3.5-27B75.6%measured
43A.X K275.5%estimated ± 7.4 pp, medium confidence
44GPT-5.275.4%measured
45GPT-5.3 Codex75.4%measured
46Qwen3.6 Plus75.2%measured
47Spark-X2.6-4B74.9%estimated ± 7.4 pp, medium confidence
48Command A+73.9%measured
49GPT-5.473.9%measured
50Gemma 4 12B73.5%measured
51GLM-5.273.3%measured
52GPT-5.4 mini73.3%measured
53GLM-5-Turbo73.2%measured
54GPT-573.1%measured
55GPT-5.172.9%measured
56GPT-5.6 Sol72.7%measured
57Qwen3.5-35B-A3B72.5%measured
58Gemma 4 26B A4B72.4%measured
59GLM-572.3%measured
60o371.4%measured
61o3-mini71.4%estimated ± 8.8 pp, medium confidence
62GPT-5.6 Terra71.2%measured
63Solar Pro 371.2%measured
64Gemini 3 Pro70.4%measured
65o170.3%measured
66Kimi K2.570.2%measured
67GPT-5.1-Codex70.0%measured
68GPT-5.1-Codex-Max70.0%measured
69GPT-OSS 120B69.0%measured
70MiMo-V2-Pro68.8%measured
71Mistral Medium 3.5 128B68.8%measured
72o4-mini68.7%measured
73GLM-4.767.9%measured
74Qwen3.6-27B67.6%measured
75Step 3.7 Flash67.3%measured
76LFM2.5-24B-A2B66.8%estimated ± 7.4 pp, medium confidence
77Ling 3.0 Flash65.4%estimated ± 7.4 pp, medium confidence
78GPT-OSS 20B65.1%measured
79K-Exaone64.7%measured
80Qwen3.6-35B-A3B64.4%measured
81Granite 4.2 3B64.1%estimated ± 7.4 pp, medium confidence
82Claude Fable 563.5%measured
83Nemotron 3 Nano Omni 30B A3B63.2%measured
84Kimi K2.7 Code63.1%measured
85Claude Opus 4.862.2%measured
86Ternary Bonsai 2 27B62.1%estimated ± 7.4 pp, medium confidence
87GLM-5V-Turbo61.1%measured
88Nemotron 3.5 Bolt E4B61.1%measured
89Ling 3.0 Flash FP859.4%estimated ± 7.4 pp, medium confidence
90Claude Opus 4.758.6%measured
91LFM3-1.7B58.4%estimated ± 7.4 pp, medium confidence
92Nemotron 3.5 Lightning 30B A3B NVFP458.1%estimated ± 7.4 pp, medium confidence
93Claude Opus 4.5 Thinking58.0%measured
94K-EXAONE 2.057.7%estimated ± 7.4 pp, medium confidence
95North Mini Code57.6%measured
96Ling 2.6 Flash57.4%measured
97Nemotron 3.5 Super VL 120B A12B NVFP456.9%estimated ± 7.4 pp, medium confidence
98Nemotron 3.5 Super VL 120B A12B56.8%estimated ± 7.4 pp, medium confidence
99Agents-A1-4B56.7%estimated ± 7.4 pp, medium confidence
100MiniCPM5-2B56.7%estimated ± 7.4 pp, medium confidence
101Hy3 Preview56.7%estimated ± 7.4 pp, medium confidence
102LFM2.5-2.6B56.7%estimated ± 7.4 pp, medium confidence
103OrcaCyber-Nano-1.056.7%estimated ± 7.4 pp, medium confidence
104ZAYA1-8B56.7%estimated ± 7.4 pp, medium confidence
105Kanana-2 1.3B Instruct56.7%estimated ± 7.4 pp, low confidence
106Kanana-2 3B Instruct56.7%estimated ± 7.4 pp, low confidence
107LFM2.5-230M56.7%estimated ± 7.4 pp, low confidence
108LFM2.5-VL-3B56.7%estimated ± 7.4 pp, low confidence
109LLaDA2.2-mini56.7%estimated ± 7.4 pp, low confidence
110MiniCPM5-1B56.7%estimated ± 7.4 pp, low confidence
111Trinity-Large-Preview56.3%measured
112Trinity-Large-Thinking56.3%measured
113LFM2.5-8B-A1B55.6%measured
114Gemini 3 Flash55.1%measured
115Claude 4 Opus Thinking53.7%measured
116Grok 453.7%measured
117MiMo-V2-Omni53.5%measured
118Claude Opus 4.6 (Adaptive)53.1%measured
119Grok 4.1 Fast (Reasoning)52.7%measured
120Qwen3.5-4B52.0%measured
121Mellum2.1-12B-A2.5B-Thinking51.5%estimated ± 8.8 pp, medium confidence
122Grok 4 Fast (Reasoning)50.5%measured
123DeepSeek V3.249.0%measured
124Gemini 2.5 Pro48.7%measured
125Claude 3.7 Sonnet Thinking48.3%measured
126Mistral Small 448.2%measured
127Llama 3.3 70B47.1%measured
128Ultravox v0.6 Llama 3.3 70B47.1%measured
129Claude 4 Sonnet45.4%measured
130Claude Opus 4.644.6%measured
131Gemma 4 E4B44.2%measured
132Qwen3 Max44.1%measured
133Claude 3.7 Sonnet44.0%measured
134Qwen3 235B 250744.0%estimated ± 8.8 pp, medium confidence
135Qwen3-Omni-30B-A3B-Thinking43.4%measured
136Claude 4 Opus43.3%measured
137Claude Opus 4.543.0%measured
138GPT-4.143.0%measured
139Llama 4 Maverick43.0%measured
140Claude 3.5 Haiku42.8%measured
141Kimi K241.5%measured
142Grok Code Fast 141.4%measured
143Claude Sonnet 4.641.2%measured
144DeepSeek V3 032441.0%measured
145Gemini 2.0 Flash40.2%measured
146MiMo-V2-Flash39.9%measured
147DeepSeek-R139.6%measured
148Llama 4 Scout39.5%measured
149Mistral Medium 339.3%measured
150Gemini 2.5 Flash39.0%measured
151Llama 3.1 405B39.0%measured
152QwQ-32B38.8%measured
153GPT-4.1 mini38.3%measured
154Nemotron Ultra 253B38.2%measured
155Nova Pro38.1%measured
156Gemma 4 E2B38.0%measured
157DeepSeek V3.137.8%measured
158GLM-4.5-Air37.6%measured
159Nemotron 3 Nano 30B37.5%measured
160GLM-4.636.7%measured
161Grok 4.1 Fast36.5%measured
162Mistral Large 336.2%measured
163Claude 3 Haiku36.1%measured
164DeepSeek V334.8%measured
165Devstral Small34.6%measured
166Sarvam 105B34.4%measured
167GPT-4o34.3%measured
168Qwen3 32B (Reasoning)33.8%estimated ± 8.8 pp, medium confidence
169Solar Pro 233.7%measured
170Phi-4-reasoning-plus33.6%estimated ± 8.8 pp, medium confidence
171Exaone 4.0 32B33.5%measured
172LFM2.5-VL-1.6B-Extract33.1%measured
173GPT-4.1 nano32.0%measured
174Gemma 3 27B31.8%measured
175Gemini 2.5 Flash-Lite31.5%measured
176Mistral Large 231.2%measured
177Qwen3-Omni-30B-A3B-Instruct31.2%measured
178GPT-4o mini31.0%measured
179Qwen3 235B-A22B (Reasoning)30.5%estimated ± 8.8 pp, medium confidence
180Qwen3 235B-A22B30.2%estimated ± 8.8 pp, medium confidence
181Qwen3 32B30.2%estimated ± 8.8 pp, medium confidence
182Mistral Small 3.129.9%measured
183Llama 3.1 70B29.0%measured
184Ternary Bonsai 8B27.7%estimated ± 8.8 pp, medium confidence
185Sarvam 30B26.5%measured
186Celeris-126.2%estimated ± 8.8 pp, medium confidence
187Granite-4.0-H-1B26.2%measured
188Llama 3.1 8B25.6%estimated ± 8.8 pp, medium confidence
189Exaone 4.0 1.2B25.3%measured
190Magistral Medium25.1%measured
191Magistral Small24.8%measured
1921-bit Bonsai 8B24.8%estimated ± 8.8 pp, medium confidence
193Phi-423.5%measured
194Phi-4-reasoning23.5%measured
195DeepSeek R1 Distill Qwen 32B22.9%measured
196Granite-4.0-1B21.8%estimated ± 8.8 pp, medium confidence
197LFM2.5-350M21.4%estimated ± 8.8 pp, medium confidence
198Mellum2-12B-A2.5B-Thinking20.9%estimated ± 8.8 pp, medium confidence
199Mellum2-12B-A2.5B-Instruct20.2%estimated ± 8.8 pp, medium confidence
200Granite-4.0-H-350M17.6%measured
201Ternary Bonsai 4B16.9%estimated ± 8.8 pp, medium confidence
202Granite-4.0-350M15.9%measured
203Ternary Bonsai 1.7B15.5%estimated ± 8.8 pp, medium confidence
2041-bit Bonsai 4B15.1%estimated ± 8.8 pp, medium confidence
2051-bit Bonsai 1.7B11.5%estimated ± 8.8 pp, medium confidence
206LFM2.5-VL-450M10.7%estimated ± 8.8 pp, medium confidence

All leaderboards

Agentic · terminal

Agentic · tools

Coding

Math

Knowledge & reasoning

Instruction following

Multilingual

Vision & documents

Long context

General