# ZAYA1-8B benchmark scores

Other · model · https://benchgap.net/model/zaya1-8b · data retrieved 2026-11-22

As of 2026-11-22, ZAYA1-8B (Other) has measured scores on 10 benchmarks and estimated scores on 34 more.

| Benchmark | Score | Source |
|---|---|---|
| [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) | 68.6% | estimated ± 4.4 pp, high confidence |
| [AA-HLE](https://benchgap.net/b/aa-hle/current.md) | 10.1% | estimated ± 3.9 pp, high confidence |
| [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) | 27.0% | estimated ± 4.7 pp, high confidence |
| [AIME26](https://benchgap.net/b/aime2026/current.md) | 89.1% | measured |
| [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) | 10.1% | estimated ± 7.4 pp, medium confidence |
| [CritPt](https://benchgap.net/b/critpt/current.md) | 0.3% | estimated ± 4.0 pp, high confidence |
| [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) | 0.0% | estimated ± 5.5 pp, low confidence |
| [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) | 71.0% | measured |
| [HLE](https://benchgap.net/b/hle/current.md) | 9.6% | estimated ± 6.5 pp, medium confidence |
| [IFBench](https://benchgap.net/b/ifbench/current.md) | 52.6% | measured |
| [LiveCodeBench v6](https://benchgap.net/b/livecodebench-v6/current.md) | 65.8% | measured |
| [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) | 10.6% | estimated ± 8.4 pp, medium confidence |
| [SciCode](https://benchgap.net/b/scicode/current.md) | 26.5% | estimated ± 4.9 pp, high confidence |
| [IFEval](https://benchgap.net/b/ifeval/current.md) | 85.6% | measured |
| [τ²-bench results](https://benchgap.net/b/tau2-bench/current.md) | 63.2% | estimated ± 12.4 pp, low confidence |
| [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) | 18.3% | estimated ± 5.7 pp, medium confidence |
| [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) | 57.5% | estimated ± 9.7 pp, low confidence |
| [BFCL v4](https://benchgap.net/b/bfcl-v4/current.md) | 39.2% | measured |
| [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) | 9.4% | estimated ± 6.0 pp, low confidence |
| [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) | 74.2% | measured |
| [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) | 56.7% | estimated ± 7.4 pp, medium confidence |
| [BBH](https://benchgap.net/b/bbh/current.md) | 92.4% | estimated ± 2.8 pp, medium confidence |
| [GPQA](https://benchgap.net/b/gpqa/current.md) | 71.0% | measured |
| [MMLU](https://benchgap.net/b/mmlu/current.md) | 86.1% | estimated ± 2.1 pp, high confidence |
| [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) | 68.9% | estimated ± 4.5 pp, high confidence |
| [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) | 79.4% | estimated ± 2.3 pp, high confidence |
| [MATH-500](https://benchgap.net/b/math-500/current.md) | 96.8% | estimated ± 3.1 pp, medium confidence |
| [MMMLU](https://benchgap.net/b/mmmlu/current.md) | 75.7% | estimated ± 1.1 pp, low confidence |
| [AIME 2025](https://benchgap.net/b/aime2025/current.md) | 89.9% | estimated ± 1.8 pp, medium confidence |
| [AA MMLU-Pro](https://benchgap.net/b/aa-mmlu-pro/current.md) | 85.3% | estimated ± 1.2 pp, low confidence |
| [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) | 23.1% | estimated ± 6.7 pp, low confidence |
| [ARC-AGI-2](https://benchgap.net/b/arc-agi-2/current.md) | 0.0% | estimated ± 10.9 pp, low confidence |
| [FrontierMath v2 (Tiers 1-3)](https://benchgap.net/b/frontiermathv2tiers13/current.md) | 5.9% | estimated ± 8.8 pp, low confidence |
| [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) | 9.4% | estimated ± 4.3 pp, medium confidence |
| [C-Eval](https://benchgap.net/b/ceval/current.md) | 88.8% | estimated ± 1.2 pp, high confidence |
| [HMMT Feb 2026](https://benchgap.net/b/hmmtfeb2026/current.md) | 71.6% | measured |
| [HMMT Nov 2025](https://benchgap.net/b/hmmtnov2025/current.md) | 80.1% | estimated ± 2.8 pp, medium confidence |
| [MMAnswerBench](https://benchgap.net/b/mmanswerbench/current.md) | 73.2% | estimated ± 1.3 pp, medium confidence |
| [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) | 86.9% | estimated ± 0.6 pp, high confidence |
| [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) | 50.4% | estimated ± 8.5 pp, low confidence |
| [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) | 79.4% | estimated ± 3.4 pp, medium confidence |
| [SimpleQA](https://benchgap.net/b/simpleqa/current.md) | 23.7% | estimated ± 11.7 pp, low confidence |
| [IMOAnswerBench](https://benchgap.net/b/imoanswerbench/current.md) | 59.3% | measured |
| [PinchBench](https://benchgap.net/b/pinchbench/current.md) | 43.5% | estimated ± 5.0 pp, low confidence |
