benchgap
Calibration

Claw-Eval → Gert Labs

Gert Labs is estimated from Claw-Eval with a Michaelis–Menten + offset curve fitted on 22 models measured on both: y = 0.0000 + 2.0000·x / (1.70099 + x), R² = 0.33, cross-validated error 9.1 pp. It is used for 7 estimates.

Estimated modelClaw-EvalGert LabsSource
GLM-5-Turbo55.8%49.4%estimated ± 9.1 pp, low confidence
K-EXAONE 2.077.7%62.7%estimated ± 9.1 pp, low confidence
LLaDA2.2-mini57.2%50.3%estimated ± 9.1 pp, low confidence
MiMo-V2-Omni45.2%42.0%estimated ± 9.1 pp, low confidence
Ornith-1.0-35B69.8%58.2%estimated ± 9.1 pp, low confidence
Ornith-1.0-397B77.1%62.4%estimated ± 9.1 pp, low confidence
Ornith-1.0-9B63.1%54.1%estimated ± 9.1 pp, low confidence