# Vals SWE-bench → OpenHarmony Bench

Calibration · https://benchgap.net/calibration/1595 · data retrieved 2026-10-29

OpenHarmony Bench is estimated from Vals SWE-bench with a linear curve fitted on 11 models measured on both: y = 0.3134·x + 0.2921, R² = 0.52, cross-validated error 3.2 pp. It is used for 13 estimates.

| Estimated model | Vals SWE-bench | OpenHarmony Bench | Source |
|---|---|---|---|
| [Claude Opus 4.7](https://benchgap.net/model/claude-opus-4-7.md) | 82.0% | 54.9% | estimated ± 3.2 pp, high confidence |
| [Composer 2.5](https://benchgap.net/model/composer-2-5.md) | 79.6% | 54.2% | estimated ± 3.2 pp, high confidence |
| [GPT-5.3 Codex](https://benchgap.net/model/gpt-5-3-codex.md) | 78.0% | 53.7% | estimated ± 3.2 pp, high confidence |
| [Claude Sonnet 4.6](https://benchgap.net/model/claude-sonnet-4-6.md) | 77.4% | 53.5% | estimated ± 3.2 pp, high confidence |
| [Gemini 3 Flash](https://benchgap.net/model/gemini-3-flash.md) | 75.0% | 52.7% | estimated ± 3.2 pp, high confidence |
| [GPT-5.2-Codex](https://benchgap.net/model/gpt-5-2-codex.md) | 72.4% | 51.9% | estimated ± 3.2 pp, high confidence |
| [Grok 4.20](https://benchgap.net/model/grok-4-20-beta.md) | 72.2% | 51.8% | estimated ± 3.2 pp, high confidence |
| [MiMo-V2.5](https://benchgap.net/model/mimo-v2-5.md) | 71.0% | 51.5% | estimated ± 3.2 pp, high confidence |
| [Claude Haiku 4.5](https://benchgap.net/model/claude-haiku-4-5.md) | 66.6% | 50.1% | estimated ± 3.2 pp, medium confidence |
| [Qwen3.5 Flash](https://benchgap.net/model/qwen3-5-flash.md) | 64.4% | 49.4% | estimated ± 3.2 pp, medium confidence |
| [Gemini 3.1 Flash-Lite](https://benchgap.net/model/gemini-3-1-flash-lite.md) | 62.8% | 48.9% | estimated ± 3.2 pp, medium confidence |
| [Laguna M.1](https://benchgap.net/model/laguna-m-1.md) | 57.6% | 47.3% | estimated ± 3.2 pp, medium confidence |
| [Laguna XS.2](https://benchgap.net/model/laguna-xs-2.md) | 55.2% | 46.5% | estimated ± 3.2 pp, medium confidence |

## Fitted on

| Model | Vals SWE-bench | OpenHarmony Bench |
|---|---|---|
| [DeepSeek V4 Flash 0731](https://benchgap.net/model/deepseek-v4-flash-0731.md) | 88.8% | 53.8% |
| [DeepSeek V4 Pro 0813](https://benchgap.net/model/deepseek-v4-pro-0813.md) | 96.4% | 59.0% |
| [GLM-5.1](https://benchgap.net/model/glm-5-1.md) | 76.4% | 52.3% |
| [GLM-5.2](https://benchgap.net/model/glm-5-2.md) | 82.8% | 58.4% |
| [GLM-5.3](https://benchgap.net/model/glm-5-3.md) | 95.4% | 60.8% |
| [GLM-5.3-Flash](https://benchgap.net/model/glm-5-3-flash.md) | 92.0% | 57.3% |
| [Kimi K2.7 Code](https://benchgap.net/model/kimi-k2-7-code.md) | 78.2% | 52.1% |
| [Kimi K3](https://benchgap.net/model/kimi-k3.md) | 93.4% | 57.3% |
| [MiniMax M3](https://benchgap.net/model/minimax-m3.md) | 75.0% | 48.4% |
| [Qwen3.7 Max](https://benchgap.net/model/qwen3-7-max.md) | 68.8% | 53.4% |
| [Qwen3.8 Max](https://benchgap.net/model/qwen3-8-max.md) | 85.6% | 60.8% |