benchgap
Other · model

Soofi S 30B-A3B benchmark scores

As of 2026-11-21, Soofi S 30B-A3B (Other) has measured scores on 4 benchmarks and estimated scores on 15 more.

BenchmarkScoreSource
AA-GPQA Diamond55.2%estimated ± 4.4 pp, medium confidence
AA-HLE0.0%estimated ± 3.9 pp, medium confidence
Artificial Analysis Intelligence Index9.4%estimated ± 7.4 pp, medium confidence
CritPt0.3%estimated ± 4.0 pp, high confidence
GPQA Diamond43.4%measured
HLE1.0%estimated ± 6.5 pp, low confidence
AA-Omniscience Accuracy2.7%estimated ± 8.4 pp, low confidence
MMLU-Pro51.4%measured
BBH78.8%measured
GPQA43.4%measured
MMLU73.8%estimated ± 2.1 pp, high confidence
Vals GPQA Diamond41.5%estimated ± 4.5 pp, high confidence
Vals MMLU-Pro63.5%estimated ± 2.3 pp, high confidence
MMMLU67.9%estimated ± 1.7 pp, high confidence
C-Eval78.5%estimated ± 1.2 pp, medium confidence
MMLU-Redux71.7%estimated ± 0.6 pp, high confidence
SuperGPQA30.6%estimated ± 12.4 pp, low confidence
MMLU-Pro (Arcee)63.1%estimated ± 3.4 pp, low confidence
SimpleQA0.0%estimated ± 11.7 pp, low confidence