Calibration
HLE-MultiChoice (Decision Index) → Artificial Analysis Decision Index v1.0
Artificial Analysis Decision Index v1.0 is estimated from HLE-MultiChoice (Decision Index) with a Michaelis–Menten curve fitted on 19 models measured on both: y = 1.0109·x / (0.10653 + x), R² = 0.68, cross-validated error 4.2 pp. It is used for 0 estimates.
Fitted on
| Model | HLE-MultiChoice (Decision Index) | Artificial Analysis Decision Index v1.0 |
|---|---|---|
| Celeris-1.1 Decision | 12.5% | 60.9% |
| Celeris-1 Decision | 13.3% | 52.3% |
| Clef | 11.1% | 48.6% |
| Clef-Flash | 10.3% | 45.8% |
| Clef-Omni | 9.0% | 44.3% |
| d1-ultra | 15.0% | 65.2% |
| Drex Max | 16.0% | 63.7% |
| Drex Max v1.1 | 17.0% | 63.8% |
| Drex v1.5 | 12.1% | 50.7% |
| Drex v2.0 | 13.6% | 57.9% |
| elephant-1 | 18.3% | 64.7% |
| GLiDE | 10.5% | 53.9% |
| GLiDE v1.2 | 17.5% | 65.0% |
| Jev 1.14 | 18.9% | 57.1% |
| d1 | 11.5% | 50.3% |
| Mercury Decide | 10.1% | 52.7% |
| Microsoft-Decision-1 | 10.9% | 53.8% |
| Perplexity Decider Flash v1.2 4B | 12.1% | 50.2% |
| Perplexity Decider v1.2 27B | 14.6% | 56.2% |