benchgap
Calibration

HLE-MultiChoice (Decision Index) → Decision Index Full Score

Decision Index Full Score is estimated from HLE-MultiChoice (Decision Index) with a offset logistic curve fitted on 11 models measured on both: y = 0.4839 + (0.6589 − 0.4839) / (1 + exp(−200.00·(x − 0.1375))), R² = 0.73, cross-validated error 6.9 pp. It is used for 0 estimates.

Fitted on

ModelHLE-MultiChoice (Decision Index)Decision Index Full Score
Clef11.1%54.9%
Clef-Flash10.3%44.4%
Clef-Omni9.0%45.0%
Drex Max16.0%66.6%
Drex v1.512.1%45.8%
Drex v2.013.6%52.8%
elephant-118.3%60.3%
GLiDE v1.217.5%73.4%
Jev 1.1418.9%60.2%
Perplexity Decider Flash v1.2 4B12.1%54.3%
Perplexity Decider v1.2 27B14.6%68.0%