Calibration
HLE-MultiChoice (Decision Index) → Decision Index Full Score
Decision Index Full Score is estimated from HLE-MultiChoice (Decision Index) with a offset logistic curve fitted on 11 models measured on both: y = 0.4839 + (0.6589 − 0.4839) / (1 + exp(−200.00·(x − 0.1375))), R² = 0.73, cross-validated error 6.9 pp. It is used for 0 estimates.
Fitted on
| Model | HLE-MultiChoice (Decision Index) | Decision Index Full Score |
|---|---|---|
| Clef | 11.1% | 54.9% |
| Clef-Flash | 10.3% | 44.4% |
| Clef-Omni | 9.0% | 45.0% |
| Drex Max | 16.0% | 66.6% |
| Drex v1.5 | 12.1% | 45.8% |
| Drex v2.0 | 13.6% | 52.8% |
| elephant-1 | 18.3% | 60.3% |
| GLiDE v1.2 | 17.5% | 73.4% |
| Jev 1.14 | 18.9% | 60.2% |
| Perplexity Decider Flash v1.2 4B | 12.1% | 54.3% |
| Perplexity Decider v1.2 27B | 14.6% | 68.0% |