benchgap
Calibration

Artificial Analysis Decision Index v1.0 → Decision Index Full Score

Decision Index Full Score is estimated from Artificial Analysis Decision Index v1.0 with a linear curve fitted on 11 models measured on both: y = 1.0715·x + -0.0197, R² = 0.68, cross-validated error 6.4 pp. It is used for 0 estimates.

Fitted on

ModelArtificial Analysis Decision Index v1.0Decision Index Full Score
Clef48.6%54.9%
Clef-Flash45.8%44.4%
Clef-Omni44.3%45.0%
Drex Max63.7%66.6%
Drex v1.550.7%45.8%
Drex v2.057.9%52.8%
elephant-164.7%60.3%
GLiDE v1.265.0%73.4%
Jev 1.1457.1%60.2%
Perplexity Decider Flash v1.2 4B50.2%54.3%
Perplexity Decider v1.2 27B56.2%68.0%