Calibration
VITA-Bench → Claw-Eval
Claw-Eval is estimated from VITA-Bench with a Hill curve fitted on 7 models measured on both: y = 0.0000 + (0.6308 − 0.0000)·x^6.00 / (0.16500^6.00 + x^6.00), R² = 0.77, cross-validated error 7.1 pp. It is used for 3 estimates.
| Estimated model | VITA-Bench | Claw-Eval | Source |
|---|---|---|---|
| Sage-A1.5 | 45.4% | 62.9% | estimated ± 7.1 pp, low confidence |
| Agents-A1-4B | 40.3% | 62.8% | estimated ± 7.1 pp, low confidence |
| Agents-A1 | 38.8% | 62.7% | estimated ± 7.1 pp, low confidence |
Fitted on
| Model | VITA-Bench | Claw-Eval |
|---|---|---|
| Claude Opus 4.5 | 23.3% | 59.6% |
| DeepSeek V3.2 | 18.5% | 40.2% |
| Qwen3.5 397B | 43.7% | 56.8% |
| Qwen3.6-35B-A3B | 35.6% | 68.7% |
| Qwen3.6 Plus | 44.3% | 58.8% |
| Qwen3.7 Max | 47.9% | 65.2% |
| Qwen3.7 Plus | 45.6% | 62.7% |