benchgap
Calibration

DeepPlanning → VITA-Bench

VITA-Bench is estimated from DeepPlanning with a Hill curve fitted on 5 models measured on both: y = 0.2005 + (0.4675 − 0.2005)·x^6.00 / (0.28699^6.00 + x^6.00), R² = 0.75, cross-validated error 8.5 pp. It is used for 0 estimates.

Fitted on

ModelDeepPlanningVITA-Bench
Claude Opus 4.526.4%23.3%
Qwen3.5 397B37.6%43.7%
Qwen3.6-35B-A3B25.9%35.6%
Qwen3.6 Plus41.5%44.3%
Qwen3.7 Plus62.3%45.6%