# AA-SciCode → DeepSWE

Calibration · https://benchgap.net/calibration/aa-sci-code/current/to/deepswe/current · data retrieved 2026-11-19

DeepSWE is estimated from AA-SciCode with a Hill curve fitted on 40 models measured on both: y = 0.0000 + (0.8063 − 0.0000)·x^6.00 / (0.42943^6.00 + x^6.00), R² = 0.39, cross-validated error 7.5 pp. It is used for 33 estimates.

| Estimated model | AA-SciCode | DeepSWE | Source |
|---|---|---|---|
| [Solar Pro 4](https://benchgap.net/model/solar-pro-4.md) | 48.0% | 53.3% | estimated ± 7.5 pp, low confidence |
| [Nemotron 3.5 Super VL 120B A12B](https://benchgap.net/model/nemotron-3-5-super-vl-120b-a12b.md) | 47.8% | 52.8% | estimated ± 7.5 pp, low confidence |
| [Nemotron 3.5 Super VL 120B A12B NVFP4](https://benchgap.net/model/nemotron-3-5-super-vl-120b-a12b-nvfp4.md) | 47.8% | 52.8% | estimated ± 7.5 pp, low confidence |
| [Gemini 2.5 Pro](https://benchgap.net/model/gemini-2-5-pro.md) | 46.3% | 49.3% | estimated ± 7.5 pp, low confidence |
| [Gemma 4 31B](https://benchgap.net/model/gemma-4-31b.md) | 45.5% | 47.2% | estimated ± 7.5 pp, low confidence |
| [Muse Glimmer 30B](https://benchgap.net/model/muse-glimmer-30b.md) | 44.9% | 45.7% | estimated ± 7.5 pp, low confidence |
| [Qwen3.5 397B](https://benchgap.net/model/qwen3-5-397b.md) | 44.8% | 45.4% | estimated ± 7.5 pp, low confidence |
| [Ling 3.0 Flash VL](https://benchgap.net/model/ling-3-0-flash-vl.md) | 44.2% | 43.8% | estimated ± 7.5 pp, low confidence |
| [Step 3.7 Flash](https://benchgap.net/model/step-3-7-flash.md) | 43.9% | 43.0% | estimated ± 7.5 pp, low confidence |
| [K-EXAONE 2.0](https://benchgap.net/model/k-exaone-2-0.md) | 42.0% | 37.6% | estimated ± 7.5 pp, low confidence |
| [A.X K2](https://benchgap.net/model/a-x-k2.md) | 41.0% | 34.8% | estimated ± 7.5 pp, low confidence |
| [Trinity-Large-Preview](https://benchgap.net/model/trinity-large-preview.md) | 40.6% | 33.6% | estimated ± 7.5 pp, low confidence |
| [Trinity-Large-Thinking](https://benchgap.net/model/trinity-large-thinking.md) | 40.6% | 33.6% | estimated ± 7.5 pp, low confidence |
| [Gemma 4 26B A4B](https://benchgap.net/model/gemma-4-26b-a4b.md) | 40.0% | 31.9% | estimated ± 7.5 pp, low confidence |
| [Nemotron 3.5 Bolt 74B-A9B](https://benchgap.net/model/nemotron-3-5-bolt-74b-a9b.md) | 39.7% | 31.0% | estimated ± 7.5 pp, low confidence |
| [Qwen3.5-122B-A10B](https://benchgap.net/model/qwen3-5-122b-a10b.md) | 39.7% | 31.0% | estimated ± 7.5 pp, low confidence |
| [DeepSeek V3 0324](https://benchgap.net/model/deepseek-v3-0324.md) | 39.0% | 29.0% | estimated ± 7.5 pp, low confidence |
| [GPT-OSS 20B](https://benchgap.net/model/gpt-oss-20b.md) | 38.9% | 28.7% | estimated ± 7.5 pp, low confidence |
| [Mistral Small 4](https://benchgap.net/model/mistral-small-4.md) | 38.8% | 28.4% | estimated ± 7.5 pp, low confidence |
| [North Mini Code](https://benchgap.net/model/north-mini-code-1-0.md) | 38.8% | 28.4% | estimated ± 7.5 pp, low confidence |
| [Command A+](https://benchgap.net/model/command-a-plus.md) | 38.5% | 27.6% | estimated ± 7.5 pp, low confidence |
| [Mercury 2.5](https://benchgap.net/model/mercury-2-5.md) | 38.5% | 27.6% | estimated ± 7.5 pp, low confidence |
| [Granite 4.2 30B](https://benchgap.net/model/granite-4-2-30b.md) | 37.8% | 25.6% | estimated ± 7.5 pp, low confidence |
| [Mistral Large 3](https://benchgap.net/model/mistral-large-3.md) | 36.6% | 22.3% | estimated ± 7.5 pp, low confidence |
| [Qwen3.6-35B-A3B](https://benchgap.net/model/qwen3-6-35b-a3b.md) | 36.6% | 22.3% | estimated ± 7.5 pp, low confidence |
| [DeepSeek V3](https://benchgap.net/model/deepseek-v3.md) | 35.8% | 20.3% | estimated ± 7.5 pp, low confidence |
| [GPT-OSS 120B](https://benchgap.net/model/gpt-oss-120b.md) | 34.0% | 15.9% | estimated ± 7.5 pp, low confidence |
| [Nemotron 3.5 Lightning 30B A3B NVFP4](https://benchgap.net/model/nemotron-3-5-lightning-30b-a3b-nvfp4.md) | 32.1% | 12.0% | estimated ± 7.5 pp, low confidence |
| [Llama 4 Maverick](https://benchgap.net/model/llama-4-maverick.md) | 31.7% | 11.2% | estimated ± 7.5 pp, low confidence |
| [Granite 4.2 8B](https://benchgap.net/model/granite-4-2-8b.md) | 31.5% | 10.9% | estimated ± 7.5 pp, low confidence |
| [Mistral Small 3.1](https://benchgap.net/model/mistral-small-3-1.md) | 27.8% | 5.5% | estimated ± 7.5 pp, low confidence |
| [MiniCPM5-2B](https://benchgap.net/model/minicpm5-2b.md) | 26.3% | 4.0% | estimated ± 7.5 pp, low confidence |
| [Solar Pro 3](https://benchgap.net/model/solar-pro-3.md) | 25.5% | 3.4% | estimated ± 7.5 pp, low confidence |

## Fitted on

| Model | AA-SciCode | DeepSWE |
|---|---|---|
| [Claude Fable 5.1](https://benchgap.net/model/claude-fable-5-1.md) | 63.1% | 67.4% |
| [Claude Fable 5.2](https://benchgap.net/model/claude-fable-5-2.md) | 67.7% | 74.3% |
| [Claude Opus 5](https://benchgap.net/model/claude-opus-5.md) | 56.4% | 68.8% |
| [Claude Opus 5.5](https://benchgap.net/model/claude-opus-5-5.md) | 66.9% | 74.2% |
| [Claude Sonnet 5.5](https://benchgap.net/model/claude-sonnet-5-5.md) | 61.0% | 71.0% |
| [DeepSeek V4.1 Flash 1017](https://benchgap.net/model/deepseek-v4-1-flash.md) | 51.9% | 77.0% |
| [DeepSeek V4 Flash 0731](https://benchgap.net/model/deepseek-v4-flash-0731.md) | 50.3% | 54.4% |
| [DeepSeek V4 Pro](https://benchgap.net/model/deepseek-v4-pro.md) | 51.0% | 62.7% |
| [Gemini 3.6 Flash](https://benchgap.net/model/gemini-3-6-flash.md) | 53.4% | 49.0% |
| [Gemini 3.7 Flash](https://benchgap.net/model/gemini-3-7-flash.md) | 57.2% | 65.3% |
| [Gemini 3.8 Flash](https://benchgap.net/model/gemini-3-8-flash.md) | 56.6% | 73.8% |
| [Gemini 4 Argon](https://benchgap.net/model/gemini-4-argon.md) | 61.8% | 77.9% |
| [GLM-5.3](https://benchgap.net/model/glm-5-3.md) | 59.0% | 66.9% |
| [GPT-5.6 Luna](https://benchgap.net/model/gpt-5-6-luna.md) | 53.6% | 67.2% |
| [GPT-5.6 Sol](https://benchgap.net/model/gpt-5-6-sol.md) | 57.1% | 72.7% |
| [GPT-5.6 Terra](https://benchgap.net/model/gpt-5-6-terra.md) | 55.0% | 69.6% |
| [GPT-6.1 Sol](https://benchgap.net/model/gpt-6-1-sol.md) | 54.2% | 71.9% |
| [GPT-6 Astra](https://benchgap.net/model/gpt-6-astra.md) | 56.5% | 74.1% |
| [GPT-6 Luna](https://benchgap.net/model/gpt-6-luna.md) | 54.6% | 66.6% |
| [GPT-6 Sol](https://benchgap.net/model/gpt-6-sol.md) | 57.6% | 68.8% |
| [Grok 4.5](https://benchgap.net/model/grok-4-5.md) | 55.0% | 53.0% |
| [Grok 4.6](https://benchgap.net/model/grok-4-6.md) | 56.5% | 65.9% |
| [Grok 4.7](https://benchgap.net/model/grok-4-7.md) | 57.4% | 71.0% |
| [Inkling 2 Small](https://benchgap.net/model/inkling-2-small.md) | 52.3% | 72.1% |
| [Kimi K3.1 Pro](https://benchgap.net/model/kimi-3-1-pro.md) | 60.8% | 75.5% |
| [Kimi K3](https://benchgap.net/model/kimi-k3.md) | 59.5% | 67.5% |
| [Ling 3.1 Flash](https://benchgap.net/model/ling-3-1-flash.md) | 54.1% | 59.7% |
| [MiMo-V2.6-Flash](https://benchgap.net/model/mimo-v2-6-flash.md) | 51.3% | 67.9% |
| [MiMo-V2.6-Pro](https://benchgap.net/model/mimo-v2-6-pro.md) | 60.9% | 71.9% |
| [MiniMax M3.1 Flash](https://benchgap.net/model/minimax-m3-1-flash.md) | 53.4% | 73.7% |
| [Muse Spark 1.1](https://benchgap.net/model/muse-spark-1-1.md) | 58.8% | 53.3% |
| [Muse Spark 1.2](https://benchgap.net/model/muse-spark-1-2.md) | 57.4% | 59.3% |
| [Muse Spark 1.3](https://benchgap.net/model/muse-spark-1-3.md) | 58.8% | 75.4% |
| [Muse Spark Open](https://benchgap.net/model/muse-spark-open.md) | 58.4% | 60.0% |
| [Muse Wonder](https://benchgap.net/model/muse-wonder.md) | 60.3% | 78.8% |
| [Muse Wonder Full](https://benchgap.net/model/muse-wonder-full.md) | 62.6% | 79.0% |
| [Qwen3.8-27B](https://benchgap.net/model/qwen3-8-27b.md) | 46.6% | 42.2% |
| [Qwen3.8-Flash-Next](https://benchgap.net/model/qwen3-8-flash-next.md) | 50.6% | 58.7% |
| [Beam 1.0 501B-A23B](https://benchgap.net/model/reflection-beam.md) | 48.5% | 43.3% |
| [Step 5 Preview](https://benchgap.net/model/step-5-preview.md) | 58.9% | 67.7% |
