# Vals LiveCodeBench → NL2Repo

Calibration · https://benchgap.net/calibration/1580 · data retrieved 2026-10-29

NL2Repo is estimated from Vals LiveCodeBench with a offset logistic curve fitted on 12 models measured on both: y = 0.4596 + (0.6498 − 0.4596) / (1 + exp(−200.00·(x − 0.8755))), R² = 0.31, cross-validated error 8.3 pp. It is used for 4 estimates.

| Estimated model | Vals LiveCodeBench | NL2Repo | Source |
|---|---|---|---|
| [GPT-5.1-Codex](https://benchgap.net/model/gpt-5-1-codex.md) | 85.6% | 46.3% | estimated ± 8.3 pp, low confidence |
| [GPT-5.1-Codex-Max](https://benchgap.net/model/gpt-5-1-codex-max.md) | 83.6% | 46.0% | estimated ± 8.3 pp, low confidence |
| [GLM-4.6](https://benchgap.net/model/glm-4-6.md) | 81.0% | 46.0% | estimated ± 8.3 pp, low confidence |
| [GLM-4.5](https://benchgap.net/model/glm-4-5.md) | 67.4% | 46.0% | estimated ± 8.3 pp, low confidence |

## Fitted on

| Model | Vals LiveCodeBench | NL2Repo |
|---|---|---|
| [DeepSeek V4 Flash 0731](https://benchgap.net/model/deepseek-v4-flash-0731.md) | 87.3% | 54.2% |
| [DeepSeek V4 Pro 0813](https://benchgap.net/model/deepseek-v4-pro-0813.md) | 87.5% | 61.5% |
| [GLM-5.1](https://benchgap.net/model/glm-5-1.md) | 81.4% | 42.7% |
| [GLM-5.2](https://benchgap.net/model/glm-5-2.md) | 69.5% | 48.9% |
| [GLM-5.3](https://benchgap.net/model/glm-5-3.md) | 80.5% | 58.0% |
| [GLM-5.3-Flash](https://benchgap.net/model/glm-5-3-flash.md) | 80.5% | 56.3% |
| [MiniMax M2.7](https://benchgap.net/model/minimax-m2-7.md) | 79.9% | 39.8% |
| [MiniMax M3](https://benchgap.net/model/minimax-m3.md) | 82.2% | 42.1% |
| [Qwen3.6 Plus](https://benchgap.net/model/qwen3-6-plus.md) | 86.0% | 37.9% |
| [Qwen3.7 Max](https://benchgap.net/model/qwen3-7-max.md) | 87.1% | 47.2% |
| [Qwen3.8-27B](https://benchgap.net/model/qwen3-8-27b.md) | 84.0% | 42.3% |
| [Qwen3.8 Max](https://benchgap.net/model/qwen3-8-max.md) | 87.9% | 55.9% |