benchgap
Calibration

WideResearch → SkillsBench

SkillsBench is estimated from WideResearch with a Hill curve fitted on 6 models measured on both: y = 0.0000 + (1.2000 − 0.0000)·x^6.00 / (0.80088^6.00 + x^6.00), R² = 0.81, cross-validated error 4.9 pp. It is used for 8 estimates.

Estimated modelWideResearchSkillsBenchSource
Kimi K2.680.8%61.6%estimated ± 4.9 pp, medium confidence
Ornith-1.5-397B80.8%61.6%estimated ± 4.9 pp, medium confidence
Claude Opus 4.576.4%51.6%estimated ± 4.9 pp, medium confidence
Qwen3.6 Plus74.3%46.7%estimated ± 4.9 pp, medium confidence
Qwen3.5 397B74.0%46.0%estimated ± 4.9 pp, medium confidence
Kimi K2.572.7%43.1%estimated ± 4.9 pp, low confidence
GLM-569.8%36.6%estimated ± 4.9 pp, low confidence
Ornith-1.5-35B-A3B67.8%32.3%estimated ± 4.9 pp, low confidence

Fitted on

ModelWideResearchSkillsBench
Atria Dawn Preview81.9%66.4%
dots3-note Preview78.9%52.8%
Hy4 preview83.9%62.9%
Ling 3.0 Flash73.6%44.8%
Ling 3.1 Flash83.3%68.7%
Qwen3.8 Max81.9%70.2%