# Vibe Code Bench → Vals SWE-bench

Calibration · https://benchgap.net/calibration/1609 · data retrieved 2026-10-29

Vals SWE-bench is estimated from Vibe Code Bench with a offset logistic curve fitted on 19 models measured on both: y = 0.0000 + (0.8323 − 0.0000) / (1 + exp(−4.17·(x − -0.2546))), R² = 0.57, cross-validated error 6.3 pp. It is used for 18 estimates.

| Estimated model | Vibe Code Bench | Vals SWE-bench | Source |
|---|---|---|---|
| [Mistral Large 4](https://benchgap.net/model/mistral-large-4.md) | 78.4% | 82.1% | estimated ± 6.3 pp, low confidence |
| [GPT-5.2](https://benchgap.net/model/gpt-5-2.md) | 53.5% | 80.2% | estimated ± 6.3 pp, medium confidence |
| [Claude Opus 4.6 (Adaptive)](https://benchgap.net/model/claude-opus-4-6-thinking.md) | 53.5% | 80.2% | estimated ± 6.3 pp, medium confidence |
| [GLM-5 (Reasoning)](https://benchgap.net/model/glm-5-reasoning.md) | 23.4% | 73.6% | estimated ± 6.3 pp, medium confidence |
| [Claude Sonnet 4.5 Thinking](https://benchgap.net/model/claude-sonnet-4-5-thinking.md) | 22.6% | 73.3% | estimated ± 6.3 pp, medium confidence |
| [GPT-5.1-Codex-Max](https://benchgap.net/model/gpt-5-1-codex-max.md) | 22.2% | 73.2% | estimated ± 6.3 pp, medium confidence |
| [Claude Opus 4.5 Thinking](https://benchgap.net/model/claude-opus-4-5-thinking.md) | 20.6% | 72.6% | estimated ± 6.3 pp, medium confidence |
| [Qwen3.5 Plus](https://benchgap.net/model/qwen3-5-plus.md) | 15.7% | 70.5% | estimated ± 6.3 pp, medium confidence |
| [MiniMax M2.5](https://benchgap.net/model/minimax-m2-5.md) | 14.9% | 70.1% | estimated ± 6.3 pp, medium confidence |
| [Gemini 3 Pro](https://benchgap.net/model/gemini-3-pro.md) | 14.3% | 69.9% | estimated ± 6.3 pp, medium confidence |
| [GPT-5 mini](https://benchgap.net/model/gpt-5-mini.md) | 14.2% | 69.8% | estimated ± 6.3 pp, medium confidence |
| [GPT-5.1-Codex](https://benchgap.net/model/gpt-5-1-codex.md) | 13.1% | 69.3% | estimated ± 6.3 pp, medium confidence |
| [Claude Haiku 4.5 Thinking](https://benchgap.net/model/claude-haiku-4-5-thinking.md) | 11.4% | 68.5% | estimated ± 6.3 pp, medium confidence |
| [DeepSeek V3.2 (Thinking)](https://benchgap.net/model/deepseek-v3-2-thinking.md) | 5.1% | 65.0% | estimated ± 6.3 pp, medium confidence |
| [Qwen3 Max](https://benchgap.net/model/qwen3-max.md) | 3.5% | 64.1% | estimated ± 6.3 pp, medium confidence |
| [GLM-4.6](https://benchgap.net/model/glm-4-6.md) | 3.1% | 63.8% | estimated ± 6.3 pp, medium confidence |
| [Grok 4.1 Fast (Reasoning)](https://benchgap.net/model/grok-4-1-fast-reasoning.md) | 1.2% | 62.6% | estimated ± 6.3 pp, medium confidence |
| [Grok 4 Fast (Reasoning)](https://benchgap.net/model/grok-4-fast-reasoning.md) | 0.0% | 61.8% | estimated ± 6.3 pp, medium confidence |

## Fitted on

| Model | Vibe Code Bench | Vals SWE-bench |
|---|---|---|
| [Claude Opus 4.7](https://benchgap.net/model/claude-opus-4-7.md) | 71.0% | 82.0% |
| [Claude Sonnet 4.6](https://benchgap.net/model/claude-sonnet-4-6.md) | 51.5% | 77.4% |
| [DeepSeek V4 Pro 0813](https://benchgap.net/model/deepseek-v4-pro-0813.md) | 49.9% | 96.4% |
| [Gemini 2.5 Pro](https://benchgap.net/model/gemini-2-5-pro.md) | 0.4% | 54.4% |
| [Gemini 3.1 Flash-Lite](https://benchgap.net/model/gemini-3-1-flash-lite.md) | 0.0% | 62.8% |
| [Gemini 3.1 Pro](https://benchgap.net/model/gemini-3-1-pro.md) | 32.0% | 78.8% |
| [Gemini 3.5 Flash](https://benchgap.net/model/gemini-3-5-flash.md) | 48.7% | 78.8% |
| [Gemini 3 Flash](https://benchgap.net/model/gemini-3-flash.md) | 20.2% | 75.0% |
| [GLM-5.1](https://benchgap.net/model/glm-5-1.md) | 31.5% | 76.4% |
| [GPT-5.2-Codex](https://benchgap.net/model/gpt-5-2-codex.md) | 37.9% | 72.4% |
| [GPT-5.3 Codex](https://benchgap.net/model/gpt-5-3-codex.md) | 61.8% | 78.0% |
| [GPT-5.4 mini](https://benchgap.net/model/gpt-5-4-mini.md) | 48.0% | 73.0% |
| [GPT-5.4 nano](https://benchgap.net/model/gpt-5-4-nano.md) | 26.1% | 69.8% |
| [GPT-5.5](https://benchgap.net/model/gpt-5-5.md) | 69.8% | 82.6% |
| [Grok 4.20](https://benchgap.net/model/grok-4-20-beta.md) | 4.1% | 72.2% |
| [Kimi K2.6](https://benchgap.net/model/kimi-2-6.md) | 37.9% | 76.2% |
| [MiniMax M2.7](https://benchgap.net/model/minimax-m2-7.md) | 27.0% | 73.8% |
| [Muse Spark](https://benchgap.net/model/muse-spark.md) | 19.7% | 74.4% |
| [Qwen3.6 Plus](https://benchgap.net/model/qwen3-6-plus.md) | 25.6% | 73.4% |