# Claw-Eval → OSWorld-Verified

Calibration · https://benchgap.net/calibration/claw-eval/current/to/osworld-verified/current · data retrieved 2026-11-18

OSWorld-Verified is estimated from Claw-Eval with a Hill curve fitted on 9 models measured on both: y = 0.0000 + (0.7519 − 0.0000)·x^6.00 / (0.39826^6.00 + x^6.00), R² = 0.49, cross-validated error 3.8 pp. It is used for 32 estimates.

| Estimated model | Claw-Eval | OSWorld-Verified | Source |
|---|---|---|---|
| [Ornith-1.5-397B](https://benchgap.net/model/ornith-1-5-397b.md) | 81.4% | 74.2% | estimated ± 3.8 pp, low confidence |
| [LongCat-2.5](https://benchgap.net/model/longcat-2-5.md) | 78.3% | 73.9% | estimated ± 3.8 pp, low confidence |
| [K-EXAONE 2.0](https://benchgap.net/model/k-exaone-2-0.md) | 77.7% | 73.9% | estimated ± 3.8 pp, low confidence |
| [Ornith-1.0-397B](https://benchgap.net/model/ornith-1-0-397b.md) | 77.1% | 73.8% | estimated ± 3.8 pp, low confidence |
| [dots3-note Preview](https://benchgap.net/model/dots3-note-preview.md) | 73.4% | 73.3% | estimated ± 3.8 pp, medium confidence |
| [Ornith-1.5-35B-A3B](https://benchgap.net/model/ornith-1-5-35b-a3b.md) | 72.5% | 73.2% | estimated ± 3.8 pp, medium confidence |
| [Qwen3.6-27B](https://benchgap.net/model/qwen3-6-27b.md) | 72.4% | 73.2% | estimated ± 3.8 pp, medium confidence |
| [Spark-X2.6-4B](https://benchgap.net/model/spark-x2-6-4b.md) | 69.9% | 72.7% | estimated ± 3.8 pp, medium confidence |
| [Ornith-1.0-35B](https://benchgap.net/model/ornith-1-0-35b.md) | 69.8% | 72.7% | estimated ± 3.8 pp, medium confidence |
| [Qwen3.6-35B-A3B](https://benchgap.net/model/qwen3-6-35b-a3b.md) | 68.7% | 72.4% | estimated ± 3.8 pp, medium confidence |
| [LFM3-1.7B](https://benchgap.net/model/lfm3-1-7b.md) | 68.6% | 72.4% | estimated ± 3.8 pp, medium confidence |
| [Step 3.7 Flash](https://benchgap.net/model/step-3-7-flash.md) | 67.1% | 72.0% | estimated ± 3.8 pp, medium confidence |
| [Ornith-1.5-9B](https://benchgap.net/model/ornith-1-5-9b.md) | 66.5% | 71.9% | estimated ± 3.8 pp, medium confidence |
| [Qwen3.7 Max](https://benchgap.net/model/qwen3-7-max.md) | 65.2% | 71.5% | estimated ± 3.8 pp, medium confidence |
| [LLaDA2.2-flash](https://benchgap.net/model/llada2-2-flash.md) | 64.2% | 71.1% | estimated ± 3.8 pp, medium confidence |
| [MiMo-V2.5-Pro](https://benchgap.net/model/mimo-v2-5-pro.md) | 63.8% | 71.0% | estimated ± 3.8 pp, medium confidence |
| [Muse Spark](https://benchgap.net/model/muse-spark.md) | 63.8% | 71.0% | estimated ± 3.8 pp, medium confidence |
| [Ornith-1.0-9B](https://benchgap.net/model/ornith-1-0-9b.md) | 63.1% | 70.7% | estimated ± 3.8 pp, medium confidence |
| [LFM2.5-2.6B](https://benchgap.net/model/lfm2-5-2-6b.md) | 62.8% | 70.6% | estimated ± 3.8 pp, medium confidence |
| [GLM-5.1](https://benchgap.net/model/glm-5-1.md) | 62.3% | 70.4% | estimated ± 3.8 pp, medium confidence |
| [MiMo-V2.5](https://benchgap.net/model/mimo-v2-5.md) | 62.3% | 70.4% | estimated ± 3.8 pp, medium confidence |
| [Qwen3.6 Plus](https://benchgap.net/model/qwen3-6-plus.md) | 58.8% | 68.6% | estimated ± 3.8 pp, medium confidence |
| [Gemini 3.1 Pro](https://benchgap.net/model/gemini-3-1-pro.md) | 57.8% | 67.9% | estimated ± 3.8 pp, medium confidence |
| [MiMo-V2-Pro](https://benchgap.net/model/mimo-v2-pro.md) | 57.8% | 67.9% | estimated ± 3.8 pp, medium confidence |
| [GLM-5](https://benchgap.net/model/glm-5.md) | 57.7% | 67.9% | estimated ± 3.8 pp, medium confidence |
| [LLaDA2.2-mini](https://benchgap.net/model/llada2-2-mini.md) | 57.2% | 67.5% | estimated ± 3.8 pp, medium confidence |
| [GLM-5-Turbo](https://benchgap.net/model/glm-5-turbo.md) | 55.8% | 66.4% | estimated ± 3.8 pp, medium confidence |
| [GLM-5V-Turbo](https://benchgap.net/model/glm-5v-turbo.md) | 53.8% | 64.6% | estimated ± 3.8 pp, medium confidence |
| [Gemini 3 Flash](https://benchgap.net/model/gemini-3-flash.md) | 49.2% | 58.7% | estimated ± 3.8 pp, low confidence |
| [MiniMax M2.7](https://benchgap.net/model/minimax-m2-7.md) | 48.7% | 57.9% | estimated ± 3.8 pp, low confidence |
| [MiMo-V2-Omni](https://benchgap.net/model/mimo-v2-omni.md) | 45.2% | 51.2% | estimated ± 3.8 pp, low confidence |
| [DeepSeek V3.2](https://benchgap.net/model/deepseek-v3-2.md) | 40.2% | 38.7% | estimated ± 3.8 pp, low confidence |

## Fitted on

| Model | Claw-Eval | OSWorld-Verified |
|---|---|---|
| [Claude Opus 4.5](https://benchgap.net/model/claude-opus-4-5.md) | 59.6% | 66.3% |
| [Claude Opus 4.6](https://benchgap.net/model/claude-opus-4-6.md) | 70.4% | 72.7% |
| [Claude Sonnet 4.6](https://benchgap.net/model/claude-sonnet-4-6.md) | 67.8% | 72.1% |
| [GPT-5.4](https://benchgap.net/model/gpt-5-4.md) | 60.3% | 75.0% |
| [Kimi K2.6](https://benchgap.net/model/kimi-2-6.md) | 62.3% | 73.1% |
| [Kimi K2.5](https://benchgap.net/model/kimi-k2-5.md) | 52.3% | 63.3% |
| [MiniMax M3](https://benchgap.net/model/minimax-m3.md) | 74.5% | 70.1% |
| [Qwen3.5 397B](https://benchgap.net/model/qwen3-5-397b.md) | 56.8% | 62.2% |
| [Qwen3.7 Plus](https://benchgap.net/model/qwen3-7-plus.md) | 62.7% | 73.3% |
