benchgap
Other · model

d1-ultra benchmark scores

As of 2026-10-29, d1-ultra (Other) has measured scores on 4 benchmarks and estimated scores on 6 more.

BenchmarkScoreSource
Decision Index Full Score63.6%estimated ± 4.5 pp, medium confidence
Decision Index Arts56.4%estimated ± 2.0 pp, medium confidence
Decision Index Knowledge41.4%estimated ± 3.6 pp, medium confidence
Decision Index Language62.6%estimated ± 4.2 pp, medium confidence
Decision Index Retrieval68.4%estimated ± 7.6 pp, low confidence
Decision Index Tools81.8%estimated ± 3.0 pp, medium confidence
HLE-MultiChoice (Decision Index)15.0%measured
Artificial Analysis Decision Index65.2%measured
When2Call (Decision Index)92.6%measured
WildGuardTest (Decision Index)95.4%measured