benchgap
Calibration

Toolathlon → JobBench

JobBench is estimated from Toolathlon with a Michaelis–Menten curve fitted on 5 models measured on both: y = 2.0000·x / (2.25199 + x), R² = 0.82, cross-validated error 7.3 pp. It is used for 2 estimates.

Estimated modelToolathlonJobBenchSource
MiniMax M2.746.3%34.1%estimated ± 7.3 pp, low confidence
Step 3.7 Flash49.5%36.0%estimated ± 7.3 pp, low confidence