# Vibe Code Bench → AA-SciCode

Calibration · https://benchgap.net/calibration/1603 · data retrieved 2026-10-29

AA-SciCode is estimated from Vibe Code Bench with a linear curve fitted on 12 models measured on both: y = 0.1451·x + 0.4574, R² = 0.54, cross-validated error 3.8 pp. It is used for 19 estimates.

| Estimated model | Vibe Code Bench | AA-SciCode | Source |
|---|---|---|---|
| [Claude Opus 4.6 (Adaptive)](https://benchgap.net/model/claude-opus-4-6-thinking.md) | 53.5% | 53.5% | estimated ± 3.8 pp, high confidence |
| [GPT-5.2-Codex](https://benchgap.net/model/gpt-5-2-codex.md) | 37.9% | 51.2% | estimated ± 3.8 pp, high confidence |
| [GLM-5 (Reasoning)](https://benchgap.net/model/glm-5-reasoning.md) | 23.4% | 49.1% | estimated ± 3.8 pp, high confidence |
| [Claude Sonnet 4.5 Thinking](https://benchgap.net/model/claude-sonnet-4-5-thinking.md) | 22.6% | 49.0% | estimated ± 3.8 pp, high confidence |
| [GPT-5.1-Codex-Max](https://benchgap.net/model/gpt-5-1-codex-max.md) | 22.2% | 49.0% | estimated ± 3.8 pp, high confidence |
| [Claude Opus 4.5 Thinking](https://benchgap.net/model/claude-opus-4-5-thinking.md) | 20.6% | 48.7% | estimated ± 3.8 pp, high confidence |
| [Gemini 3 Flash](https://benchgap.net/model/gemini-3-flash.md) | 20.2% | 48.7% | estimated ± 3.8 pp, high confidence |
| [Qwen3.5 Plus](https://benchgap.net/model/qwen3-5-plus.md) | 15.7% | 48.0% | estimated ± 3.8 pp, high confidence |
| [MiniMax M2.5](https://benchgap.net/model/minimax-m2-5.md) | 14.9% | 47.9% | estimated ± 3.8 pp, high confidence |
| [Gemini 3 Pro](https://benchgap.net/model/gemini-3-pro.md) | 14.3% | 47.8% | estimated ± 3.8 pp, high confidence |
| [GPT-5 mini](https://benchgap.net/model/gpt-5-mini.md) | 14.2% | 47.8% | estimated ± 3.8 pp, high confidence |
| [GPT-5.1-Codex](https://benchgap.net/model/gpt-5-1-codex.md) | 13.1% | 47.6% | estimated ± 3.8 pp, high confidence |
| [Claude Haiku 4.5 Thinking](https://benchgap.net/model/claude-haiku-4-5-thinking.md) | 11.4% | 47.4% | estimated ± 3.8 pp, high confidence |
| [DeepSeek V3.2 (Thinking)](https://benchgap.net/model/deepseek-v3-2-thinking.md) | 5.1% | 46.5% | estimated ± 3.8 pp, high confidence |
| [Qwen3 Max](https://benchgap.net/model/qwen3-max.md) | 3.5% | 46.2% | estimated ± 3.8 pp, high confidence |
| [GLM-4.6](https://benchgap.net/model/glm-4-6.md) | 3.1% | 46.2% | estimated ± 3.8 pp, high confidence |
| [Grok 4.1 Fast (Reasoning)](https://benchgap.net/model/grok-4-1-fast-reasoning.md) | 1.2% | 45.9% | estimated ± 3.8 pp, high confidence |
| [Gemini 3.1 Flash-Lite](https://benchgap.net/model/gemini-3-1-flash-lite.md) | 0.0% | 45.7% | estimated ± 3.8 pp, medium confidence |
| [Grok 4 Fast (Reasoning)](https://benchgap.net/model/grok-4-fast-reasoning.md) | 0.0% | 45.7% | estimated ± 3.8 pp, medium confidence |

## Fitted on

| Model | Vibe Code Bench | AA-SciCode |
|---|---|---|
| [DeepSeek V4 Pro 0813](https://benchgap.net/model/deepseek-v4-pro-0813.md) | 49.9% | 51.0% |
| [Gemini 2.5 Pro](https://benchgap.net/model/gemini-2-5-pro.md) | 0.4% | 46.3% |
| [Gemini 3.1 Pro](https://benchgap.net/model/gemini-3-1-pro.md) | 32.0% | 58.7% |
| [Gemini 3.5 Flash](https://benchgap.net/model/gemini-3-5-flash.md) | 48.7% | 53.9% |
| [Gemini 4 Argon](https://benchgap.net/model/gemini-4-argon.md) | 91.9% | 61.8% |
| [GLM-5.1](https://benchgap.net/model/glm-5-1.md) | 31.5% | 44.8% |
| [GPT-5.4 mini](https://benchgap.net/model/gpt-5-4-mini.md) | 48.0% | 52.1% |
| [GPT-5.4 nano](https://benchgap.net/model/gpt-5-4-nano.md) | 26.1% | 47.2% |
| [GPT-5.5](https://benchgap.net/model/gpt-5-5.md) | 69.8% | 55.8% |
| [Kimi K2.6](https://benchgap.net/model/kimi-2-6.md) | 37.9% | 51.5% |
| [MiniMax M2.7](https://benchgap.net/model/minimax-m2-7.md) | 27.0% | 50.1% |
| [Mistral Large 4](https://benchgap.net/model/mistral-large-4.md) | 78.4% | 54.2% |