# AA-SciCode → FrontierSWE v2

Calibration · https://benchgap.net/calibration/aa-sci-code/current/to/frontierswev2/current · data retrieved 2026-11-18

FrontierSWE v2 is estimated from AA-SciCode with a Hill curve fitted on 20 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.66441^6.00 + x^6.00), R² = 0.49, cross-validated error 14.2 pp. It is used for 33 estimates.

| Estimated model | AA-SciCode | FrontierSWE v2 | Source |
|---|---|---|---|
| [Step 5 Preview](https://benchgap.net/model/step-5-preview.md) | 58.9% | 39.2% | estimated ± 14.2 pp, low confidence |
| [GPT-6.1 Terra](https://benchgap.net/model/gpt-6-1-terra.md) | 55.1% | 29.5% | estimated ± 14.2 pp, low confidence |
| [Qwen3.8 Max Preview](https://benchgap.net/model/qwen3-8-max-preview.md) | 52.1% | 22.6% | estimated ± 14.2 pp, low confidence |
| [MiMo-V2.6-Flash](https://benchgap.net/model/mimo-v2-6-flash.md) | 51.3% | 21.0% | estimated ± 14.2 pp, low confidence |
| [Hy3](https://benchgap.net/model/hy3.md) | 48.6% | 15.9% | estimated ± 14.2 pp, low confidence |
| [Hy3 Preview](https://benchgap.net/model/hy3-preview.md) | 48.6% | 15.9% | estimated ± 14.2 pp, low confidence |
| [Quasar 438B](https://benchgap.net/model/quasar-438b.md) | 48.1% | 15.1% | estimated ± 14.2 pp, low confidence |
| [Solar Pro 4](https://benchgap.net/model/solar-pro-4.md) | 48.0% | 14.9% | estimated ± 14.2 pp, low confidence |
| [Gemini 2.5 Pro](https://benchgap.net/model/gemini-2-5-pro.md) | 46.3% | 12.3% | estimated ± 14.2 pp, low confidence |
| [Apodex 1.1](https://benchgap.net/model/apodex-1-1.md) | 45.5% | 11.2% | estimated ± 14.2 pp, low confidence |
| [Apodex 1.1 Mini](https://benchgap.net/model/apodex-1-1-mini.md) | 45.5% | 11.2% | estimated ± 14.2 pp, low confidence |
| [Gemma 4 31B](https://benchgap.net/model/gemma-4-31b.md) | 45.5% | 11.2% | estimated ± 14.2 pp, low confidence |
| [Ling 3.0 Flash VL](https://benchgap.net/model/ling-3-0-flash-vl.md) | 44.2% | 9.6% | estimated ± 14.2 pp, low confidence |
| [K-EXAONE 2.0](https://benchgap.net/model/k-exaone-2-0.md) | 42.0% | 7.2% | estimated ± 14.2 pp, low confidence |
| [A.X K2](https://benchgap.net/model/a-x-k2.md) | 41.0% | 6.3% | estimated ± 14.2 pp, low confidence |
| [Trinity-Large-Preview](https://benchgap.net/model/trinity-large-preview.md) | 40.6% | 5.9% | estimated ± 14.2 pp, low confidence |
| [Trinity-Large-Thinking](https://benchgap.net/model/trinity-large-thinking.md) | 40.6% | 5.9% | estimated ± 14.2 pp, low confidence |
| [Gemma 4 26B A4B](https://benchgap.net/model/gemma-4-26b-a4b.md) | 40.0% | 5.5% | estimated ± 14.2 pp, low confidence |
| [Nemotron 3.5 Bolt 74B-A9B](https://benchgap.net/model/nemotron-3-5-bolt-74b-a9b.md) | 39.7% | 5.2% | estimated ± 14.2 pp, low confidence |
| [Qwen3.5-122B-A10B](https://benchgap.net/model/qwen3-5-122b-a10b.md) | 39.7% | 5.2% | estimated ± 14.2 pp, low confidence |
| [DeepSeek V3 0324](https://benchgap.net/model/deepseek-v3-0324.md) | 39.0% | 4.7% | estimated ± 14.2 pp, low confidence |
| [GPT-OSS 20B](https://benchgap.net/model/gpt-oss-20b.md) | 38.9% | 4.6% | estimated ± 14.2 pp, low confidence |
| [Mistral Small 4](https://benchgap.net/model/mistral-small-4.md) | 38.8% | 4.6% | estimated ± 14.2 pp, low confidence |
| [North Mini Code](https://benchgap.net/model/north-mini-code-1-0.md) | 38.8% | 4.6% | estimated ± 14.2 pp, low confidence |
| [Command A+](https://benchgap.net/model/command-a-plus.md) | 38.5% | 4.4% | estimated ± 14.2 pp, low confidence |
| [Mercury 2.5](https://benchgap.net/model/mercury-2-5.md) | 38.5% | 4.4% | estimated ± 14.2 pp, low confidence |
| [Mistral Large 3](https://benchgap.net/model/mistral-large-3.md) | 36.6% | 3.3% | estimated ± 14.2 pp, low confidence |
| [DeepSeek V3](https://benchgap.net/model/deepseek-v3.md) | 35.8% | 2.9% | estimated ± 14.2 pp, low confidence |
| [GPT-OSS 120B](https://benchgap.net/model/gpt-oss-120b.md) | 34.0% | 2.1% | estimated ± 14.2 pp, low confidence |
| [Nemotron 3.5 Lightning 30B A3B NVFP4](https://benchgap.net/model/nemotron-3-5-lightning-30b-a3b-nvfp4.md) | 32.1% | 1.5% | estimated ± 14.2 pp, low confidence |
| [Llama 4 Maverick](https://benchgap.net/model/llama-4-maverick.md) | 31.7% | 1.4% | estimated ± 14.2 pp, low confidence |
| [Mistral Small 3.1](https://benchgap.net/model/mistral-small-3-1.md) | 27.8% | 0.6% | estimated ± 14.2 pp, low confidence |
| [MiniCPM5-2B](https://benchgap.net/model/minicpm5-2b.md) | 26.3% | 0.5% | estimated ± 14.2 pp, low confidence |

## Fitted on

| Model | AA-SciCode | FrontierSWE v2 |
|---|---|---|
| [Claude Fable 5](https://benchgap.net/model/claude-fable.md) | 61.0% | 47.0% |
| [Claude Fable 5.1](https://benchgap.net/model/claude-fable-5-1.md) | 63.1% | 56.3% |
| [Claude Fable 5.2](https://benchgap.net/model/claude-fable-5-2.md) | 67.7% | 69.9% |
| [Claude Haiku 5.5](https://benchgap.net/model/claude-haiku-5-5.md) | 55.0% | 43.8% |
| [Claude Opus 5](https://benchgap.net/model/claude-opus-5.md) | 56.4% | 52.0% |
| [Claude Opus 5.5](https://benchgap.net/model/claude-opus-5-5.md) | 66.9% | 62.3% |
| [Claude Sonnet 5.5](https://benchgap.net/model/claude-sonnet-5-5.md) | 61.0% | 61.9% |
| [Gemini 3.7 Flash](https://benchgap.net/model/gemini-3-7-flash.md) | 57.2% | 20.3% |
| [Gemini 3.8 Flash](https://benchgap.net/model/gemini-3-8-flash.md) | 56.6% | 19.6% |
| [Gemini 4 Argon](https://benchgap.net/model/gemini-4-argon.md) | 61.8% | 55.0% |
| [GLM-5.3](https://benchgap.net/model/glm-5-3.md) | 59.0% | 30.2% |
| [GPT-5.6 Sol](https://benchgap.net/model/gpt-5-6-sol.md) | 57.1% | 32.2% |
| [GPT-6 Astra](https://benchgap.net/model/gpt-6-astra.md) | 56.5% | 65.5% |
| [Grok 4.6](https://benchgap.net/model/grok-4-6.md) | 56.5% | 25.3% |
| [Grok 4.7](https://benchgap.net/model/grok-4-7.md) | 57.4% | 29.5% |
| [Inkling](https://benchgap.net/model/inkling.md) | 47.0% | 4.1% |
| [Inkling 2 Small](https://benchgap.net/model/inkling-2-small.md) | 52.3% | 25.1% |
| [Kimi K3](https://benchgap.net/model/kimi-k3.md) | 59.5% | 25.9% |
| [Muse Spark 1.2](https://benchgap.net/model/muse-spark-1-2.md) | 57.4% | 12.0% |
| [Muse Spark 1.3](https://benchgap.net/model/muse-spark-1-3.md) | 58.8% | 25.8% |
