benchgap
Multilingual

SWE Multilingual leaderboard

As of 2026-11-22, the highest measured score on SWE Multilingual is 96.6% by Claude Fable 5.2. 5 more models have estimated scores, calibrated from the benchmarks they were measured on.

Measured scores: benchlm.ai.

#ModelScoreSource
1Claude Fable 5.296.6%measured
2Claude Opus 5.593.9%measured
3Claude Mythos 592.2%measured
4Claude Sonnet 5.590.3%measured
5Claude Opus 589.5%measured
6Claude Fable 5.189.1%measured
7Ling 3.1 Flash88.5%measured
8Claude Opus 4.884.4%measured
9Hy4 preview82.9%measured
10Inkling 2 Small81.2%measured
11Qwen3.8-Flash-Next81.0%measured
12Qwen3.8-Omni-Flash80.5%measured
13Composer 2.579.8%measured
14Ornith-1.5-397B79.6%measured
15Ornith-1.0-397B78.9%measured
16Laguna S 2.178.5%measured
17Claude Sonnet 578.3%measured
18Qwen3.7 Max78.3%measured
19Beam 1.0 501B-A23B78.3%measured
20Beam 1.0 501B-A23B FP878.1%measured
21Grok 4.578.0%measured
22SWE-1.777.8%measured
23Claude Opus 4.577.5%measured
24Beam 1.0 501B-A23B NVFP477.5%measured
25Kimi K2.676.7%measured
26MiniMax M2.776.5%measured
27DeepSeek V4 Pro76.2%measured
28Qwen3.7 Plus75.8%measured
29dots3-note Preview75.7%measured
30Qwen3.6 Plus73.8%measured
31Composer 273.7%measured
32Inkling 2 Mini73.7%measured
33DeepSeek V4 Flash 073173.3%measured
34GLM-573.3%measured
35Qwen3 235B-A22B (Reasoning)73.2%estimated ± 3.7 pp, low confidence
36Kimi K2.573.0%measured
37Sage-A1.572.7%measured
38Ling 3.0 Flash72.4%measured
39MiMo-V2-Flash71.7%measured
40Ornith-1.5-35B-A3B71.4%measured
41Qwen3.6-27B71.3%measured
42Qwen3.5-122B-A10B69.9%estimated ± 3.2 pp, low confidence
43Qwen3.5-27B69.9%estimated ± 3.2 pp, low confidence
44Ornith-1.0-35B69.3%measured
45Qwen3.5 397B69.3%measured
46Qwen3.5-35B-A3B68.1%estimated ± 3.2 pp, low confidence
47Nemotron 3.5 Super VL 120B A12B67.7%measured
48Nemotron 3 Ultra67.7%measured
49Qwen3.6-35B-A3B67.2%measured
50Nemotron 3.5 Super VL 120B A12B NVFP467.0%measured
51Qwen3 235B 250765.7%estimated ± 3.2 pp, low confidence
52Spark-X2.6-4B64.7%measured
53Laguna M.163.1%measured
54Laguna XS 2.163.1%measured
55LongCat-Flash-Lite-Sparse59.3%measured
56Laguna XS.257.7%measured
57Qwen3-Coder 480B-A35B54.7%measured
58Ornith-1.5-9B54.4%measured
59Ornith-1.0-9B52.0%measured
60Kimi K247.3%measured
61Granite 4.2 30B41.9%measured
62Nemotron 3.5 Lightning 30B A3B NVFP436.5%measured
63Granite 4.2 8B30.8%measured
64LLaDA2.2-flash25.0%measured
65LFM3-1.7B23.0%measured

All leaderboards

Agentic · terminal

Agentic · tools

Coding

Math

Knowledge & reasoning

Instruction following

Multilingual

Vision & documents

Long context

General