benchgap
Calibration

AA EnterpriseOps-Gym → τ²-bench results

τ²-bench results is estimated from AA EnterpriseOps-Gym with a Michaelis–Menten curve fitted on 5 models measured on both: y = 1.2017·x / (0.12138 + x), R² = 0.94, cross-validated error 2.4 pp. It is used for 8 estimates.

Estimated modelAA EnterpriseOps-Gymτ²-bench resultsSource
GLM-5.336.4%90.1%estimated ± 2.4 pp, medium confidence
GLM-5.3-Flash33.2%88.0%estimated ± 2.4 pp, medium confidence
Grok 4.648.3%96.0%estimated ± 2.4 pp, medium confidence
Inkling38.0%91.1%estimated ± 2.4 pp, medium confidence
Kimi K345.3%94.8%estimated ± 2.4 pp, medium confidence
Muse Glimmer 30B34.7%89.0%estimated ± 2.4 pp, medium confidence
Qwen3.8-27B44.2%94.3%estimated ± 2.4 pp, medium confidence
Step 5 Preview47.2%95.6%estimated ± 2.4 pp, medium confidence