# Vibe Code Bench → SWE-bench Verified

Calibration · https://benchgap.net/calibration/1607 · data retrieved 2026-10-29

SWE-bench Verified is estimated from Vibe Code Bench with a linear curve fitted on 11 models measured on both: y = 0.1886·x + 0.7165, R² = 0.61, cross-validated error 4.4 pp. It is used for 24 estimates.

| Estimated model | Vibe Code Bench | SWE-bench Verified | Source |
|---|---|---|---|
| [Gemini 4 Argon](https://benchgap.net/model/gemini-4-argon.md) | 91.9% | 89.0% | estimated ± 4.4 pp, medium confidence |
| [Mistral Large 4](https://benchgap.net/model/mistral-large-4.md) | 78.4% | 86.4% | estimated ± 4.4 pp, medium confidence |
| [Claude Opus 4.6 (Adaptive)](https://benchgap.net/model/claude-opus-4-6-thinking.md) | 53.5% | 81.7% | estimated ± 4.4 pp, high confidence |
| [GPT-5.2-Codex](https://benchgap.net/model/gpt-5-2-codex.md) | 37.9% | 78.8% | estimated ± 4.4 pp, high confidence |
| [GPT-5.4 nano](https://benchgap.net/model/gpt-5-4-nano.md) | 26.1% | 76.6% | estimated ± 4.4 pp, high confidence |
| [GPT-5.1](https://benchgap.net/model/gpt-5-1.md) | 24.6% | 76.3% | estimated ± 4.4 pp, high confidence |
| [GLM-5 (Reasoning)](https://benchgap.net/model/glm-5-reasoning.md) | 23.4% | 76.1% | estimated ± 4.4 pp, high confidence |
| [Claude Sonnet 4.5 Thinking](https://benchgap.net/model/claude-sonnet-4-5-thinking.md) | 22.6% | 75.9% | estimated ± 4.4 pp, high confidence |
| [GPT-5.1-Codex-Max](https://benchgap.net/model/gpt-5-1-codex-max.md) | 22.2% | 75.8% | estimated ± 4.4 pp, high confidence |
| [Claude Opus 4.5 Thinking](https://benchgap.net/model/claude-opus-4-5-thinking.md) | 20.6% | 75.5% | estimated ± 4.4 pp, high confidence |
| [Gemini 3 Flash](https://benchgap.net/model/gemini-3-flash.md) | 20.2% | 75.5% | estimated ± 4.4 pp, high confidence |
| [GPT-5 (high)](https://benchgap.net/model/gpt-5-high.md) | 20.1% | 75.4% | estimated ± 4.4 pp, high confidence |
| [Qwen3.5 Plus](https://benchgap.net/model/qwen3-5-plus.md) | 15.7% | 74.6% | estimated ± 4.4 pp, high confidence |
| [MiniMax M2.5](https://benchgap.net/model/minimax-m2-5.md) | 14.9% | 74.5% | estimated ± 4.4 pp, high confidence |
| [Gemini 3 Pro](https://benchgap.net/model/gemini-3-pro.md) | 14.3% | 74.4% | estimated ± 4.4 pp, high confidence |
| [GPT-5 mini](https://benchgap.net/model/gpt-5-mini.md) | 14.2% | 74.3% | estimated ± 4.4 pp, high confidence |
| [GPT-5.1-Codex](https://benchgap.net/model/gpt-5-1-codex.md) | 13.1% | 74.1% | estimated ± 4.4 pp, high confidence |
| [Claude Haiku 4.5 Thinking](https://benchgap.net/model/claude-haiku-4-5-thinking.md) | 11.4% | 73.8% | estimated ± 4.4 pp, high confidence |
| [DeepSeek V3.2 (Thinking)](https://benchgap.net/model/deepseek-v3-2-thinking.md) | 5.1% | 72.6% | estimated ± 4.4 pp, high confidence |
| [Qwen3 Max](https://benchgap.net/model/qwen3-max.md) | 3.5% | 72.3% | estimated ± 4.4 pp, high confidence |
| [GLM-4.6](https://benchgap.net/model/glm-4-6.md) | 3.1% | 72.2% | estimated ± 4.4 pp, high confidence |
| [Grok 4.1 Fast (Reasoning)](https://benchgap.net/model/grok-4-1-fast-reasoning.md) | 1.2% | 71.9% | estimated ± 4.4 pp, high confidence |
| [Gemini 3.1 Flash-Lite](https://benchgap.net/model/gemini-3-1-flash-lite.md) | 0.0% | 71.7% | estimated ± 4.4 pp, medium confidence |
| [Grok 4 Fast (Reasoning)](https://benchgap.net/model/grok-4-fast-reasoning.md) | 0.0% | 71.7% | estimated ± 4.4 pp, medium confidence |

## Fitted on

| Model | Vibe Code Bench | SWE-bench Verified |
|---|---|---|
| [Claude Opus 4.6](https://benchgap.net/model/claude-opus-4-6.md) | 57.6% | 80.8% |
| [Claude Sonnet 4.6](https://benchgap.net/model/claude-sonnet-4-6.md) | 51.5% | 79.6% |
| [DeepSeek V4 Pro 0813](https://benchgap.net/model/deepseek-v4-pro-0813.md) | 49.9% | 80.6% |
| [Gemini 2.5 Pro](https://benchgap.net/model/gemini-2-5-pro.md) | 0.4% | 63.8% |
| [GPT-5.2](https://benchgap.net/model/gpt-5-2.md) | 53.5% | 80.0% |
| [GPT-5.3 Codex](https://benchgap.net/model/gpt-5-3-codex.md) | 61.8% | 85.0% |
| [Grok 4.20](https://benchgap.net/model/grok-4-20-beta.md) | 4.1% | 76.7% |
| [Kimi K2.6](https://benchgap.net/model/kimi-2-6.md) | 37.9% | 80.2% |
| [Kimi K2.5 (Reasoning)](https://benchgap.net/model/kimi-k2-5-reasoning.md) | 17.5% | 76.8% |
| [Muse Spark](https://benchgap.net/model/muse-spark.md) | 19.7% | 77.4% |
| [Qwen3.6 Plus](https://benchgap.net/model/qwen3-6-plus.md) | 25.6% | 78.8% |