benchgap
Calibration

Decision Index Full Score → HLE-MultiChoice (Decision Index)

HLE-MultiChoice (Decision Index) is estimated from Decision Index Full Score with a Michaelis–Menten curve fitted on 11 models measured on both: y = 2.0000·x / (7.54090 + x), R² = 0.58, cross-validated error 2.3 pp. It is used for 0 estimates.

Fitted on

ModelDecision Index Full ScoreHLE-MultiChoice (Decision Index)
Clef54.9%11.1%
Clef-Flash44.4%10.3%
Clef-Omni45.0%9.0%
Drex Max66.6%16.0%
Drex v1.545.8%12.1%
Drex v2.052.8%13.6%
elephant-160.3%18.3%
GLiDE v1.273.4%17.5%
Jev 1.1460.2%18.9%
Perplexity Decider Flash v1.2 4B54.3%12.1%
Perplexity Decider v1.2 27B68.0%14.6%