# SWE-bench Pro → OpenHarmony Bench

Calibration · https://benchgap.net/calibration/1468 · data retrieved 2026-10-29

OpenHarmony Bench is estimated from SWE-bench Pro with a offset logistic curve fitted on 7 models measured on both: y = 0.5328 + (0.6090 − 0.5328) / (1 + exp(−200.00·(x − 0.6181))), R² = 0.50, cross-validated error 4.9 pp. It is used for 14 estimates.

| Estimated model | SWE-bench Pro | OpenHarmony Bench | Source |
|---|---|---|---|
| [Claude Mythos 5](https://benchgap.net/model/claude-mythos-5.md) | 80.3% | 60.9% | estimated ± 4.9 pp, low confidence |
| [Sakana Fugu-Ultra](https://benchgap.net/model/sakana-fugu-ultra.md) | 73.7% | 60.9% | estimated ± 4.9 pp, low confidence |
| [Beam 1.0 501B-A23B FP8](https://benchgap.net/model/reflection-beam-fp8.md) | 65.9% | 60.9% | estimated ± 4.9 pp, low confidence |
| [Beam 1.0 501B-A23B NVFP4](https://benchgap.net/model/reflection-beam-nvfp4.md) | 65.6% | 60.9% | estimated ± 4.9 pp, low confidence |
| [Sage-A1.5](https://benchgap.net/model/sage-a1-5.md) | 61.2% | 55.0% | estimated ± 4.9 pp, low confidence |
| [Atria Dawn Preview](https://benchgap.net/model/atria-dawn-preview.md) | 59.6% | 53.4% | estimated ± 4.9 pp, low confidence |
| [Laguna S 2.1](https://benchgap.net/model/laguna-s-2-1.md) | 59.4% | 53.3% | estimated ± 4.9 pp, low confidence |
| [Sakana Fugu](https://benchgap.net/model/sakana-fugu.md) | 59.0% | 53.3% | estimated ± 4.9 pp, low confidence |
| [GPT-5.2](https://benchgap.net/model/gpt-5-2.md) | 55.6% | 53.3% | estimated ± 4.9 pp, low confidence |
| [Spark-X2.6-4B](https://benchgap.net/model/spark-x2-6-4b.md) | 54.3% | 53.3% | estimated ± 4.9 pp, low confidence |
| [Claude Opus 4.6](https://benchgap.net/model/claude-opus-4-6.md) | 53.4% | 53.3% | estimated ± 4.9 pp, low confidence |
| [MAI-Thinking-1](https://benchgap.net/model/mai-thinking-1.md) | 52.8% | 53.3% | estimated ± 4.9 pp, low confidence |
| [Laguna XS 2.1](https://benchgap.net/model/laguna-xs-2-1.md) | 47.6% | 53.3% | estimated ± 4.9 pp, low confidence |
| [LongCat-Flash-Lite-Sparse](https://benchgap.net/model/longcat-flash-lite-sparse.md) | 40.6% | 53.3% | estimated ± 4.9 pp, low confidence |

## Fitted on

| Model | SWE-bench Pro | OpenHarmony Bench |
|---|---|---|
| [DeepSeek V4 Flash 0731](https://benchgap.net/model/deepseek-v4-flash-0731.md) | 52.6% | 53.8% |
| [DeepSeek V4 Pro 0813](https://benchgap.net/model/deepseek-v4-pro-0813.md) | 55.4% | 59.0% |
| [GLM-5.1](https://benchgap.net/model/glm-5-1.md) | 58.4% | 52.3% |
| [GLM-5.2](https://benchgap.net/model/glm-5-2.md) | 62.1% | 58.4% |
| [MiniMax M3](https://benchgap.net/model/minimax-m3.md) | 59.0% | 48.4% |
| [Qwen3.7 Max](https://benchgap.net/model/qwen3-7-max.md) | 60.6% | 53.4% |
| [Qwen3.8 Max](https://benchgap.net/model/qwen3-8-max.md) | 67.7% | 60.8% |
