# Beam 1.0 501B-A23B FP8 benchmark scores

Other · model · https://benchgap.net/model/reflection-beam-fp8 · data retrieved 2026-10-29

As of 2026-10-29, Beam 1.0 501B-A23B FP8 (Other) has measured scores on 19 benchmarks and estimated scores on 99 more.

| Benchmark | Score | Source |
|---|---|---|
| [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) | 89.2% | estimated ± 2.7 pp, high confidence |
| [AA-HLE](https://benchgap.net/b/aa-hle/current.md) | 35.7% | estimated ± 3.8 pp, high confidence |
| [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) | 47.8% | estimated ± 3.0 pp, high confidence |
| [AIME26](https://benchgap.net/b/aime2026/current.md) | 98.0% | measured |
| [CritPt](https://benchgap.net/b/critpt/current.md) | 17.4% | measured |
| [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) | 37.9% | estimated ± 7.7 pp, medium confidence |
| [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) | 90.3% | measured |
| [HLE](https://benchgap.net/b/hle/current.md) | 43.8% | estimated ± 6.6 pp, medium confidence |
| [IFBench](https://benchgap.net/b/ifbench/current.md) | 80.7% | measured |
| [AA-LCR](https://benchgap.net/b/lcr/current.md) | 79.4% | measured |
| [LiveCodeBench v6](https://benchgap.net/b/livecodebench-v6/current.md) | 91.8% | estimated ± 2.7 pp, high confidence |
| [SciCode](https://benchgap.net/b/scicode/current.md) | 48.3% | measured |
| [Terminal-Bench 2.1](https://benchgap.net/b/terminalbench21/current.md) | 78.9% | measured |
| [BrowseComp](https://benchgap.net/b/browsecomp/current.md) | 76.7% | measured |
| [HLE w/ tools](https://benchgap.net/b/hlewithtools/current.md) | 51.1% | measured |
| [IFEval](https://benchgap.net/b/ifeval/current.md) | 94.8% | estimated ± 3.6 pp, high confidence |
| [LongBench v2](https://benchgap.net/b/longbench-v2/current.md) | 67.6% | measured |
| [VITA-Bench](https://benchgap.net/b/vitabench/current.md) | 43.7% | estimated ± 6.7 pp, low confidence |
| [τ²-bench results](https://benchgap.net/b/tau2-bench/current.md) | 97.0% | estimated ± 3.1 pp, high confidence |
| [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) | 67.8% | estimated ± 2.5 pp, high confidence |
| [APEX-Agents](https://benchgap.net/b/apexagents/current.md) | 35.1% | estimated ± 0.6 pp, medium confidence |
| [APEX-Agents-AA](https://benchgap.net/b/apexagentsaa/current.md) | 22.8% | estimated ± 4.2 pp, high confidence |
| [BioMysteryBench (human-difficult)](https://benchgap.net/b/biomysterybenchhumandifficult/current.md) | 47.4% | estimated ± 6.8 pp, low confidence |
| [DeepSearchQA](https://benchgap.net/b/deepsearchqa/current.md) | 79.6% | measured |
| [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) | 80.2% | measured |
| [AutomationBench](https://benchgap.net/b/automationbench/current.md) | 26.6% | estimated ± 10.5 pp, low confidence |
| [BFCL v4](https://benchgap.net/b/bfcl-v4/current.md) | 76.4% | estimated ± 4.7 pp, low confidence |
| [CyberGym](https://benchgap.net/b/cybergym/current.md) | 66.9% | estimated ± 7.3 pp, medium confidence |
| [JobBench](https://benchgap.net/b/jobbench/current.md) | 52.1% | estimated ± 6.4 pp, medium confidence |
| [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) | 65.9% | measured |
| [τ³-bench results](https://benchgap.net/b/tau3-bench/current.md) | 36.8% | measured |
| [WideResearch](https://benchgap.net/b/wideresearch/current.md) | 76.2% | estimated ± 3.5 pp, high confidence |
| [AA Agentic Index](https://benchgap.net/b/aa-agentic-index/current.md) | 4.9% | estimated ± 5.9 pp, medium confidence |
| [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) | 85.5% | estimated ± 2.5 pp, medium confidence |
| [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) | 80.4% | estimated ± 7.4 pp, medium confidence |
| [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) | 25.4% | estimated ± 6.1 pp, medium confidence |
| [GPQA](https://benchgap.net/b/gpqa/current.md) | 90.2% | estimated ± 1.2 pp, high confidence |
| [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) | 33.1% | estimated ± 8.1 pp, medium confidence |
| [MATH-500](https://benchgap.net/b/math-500/current.md) | 98.0% | estimated ± 3.1 pp, low confidence |
| [MMMLU](https://benchgap.net/b/mmmlu/current.md) | 90.5% | estimated ± 0.7 pp, low confidence |
| [AA MMLU-Pro](https://benchgap.net/b/aa-mmlu-pro/current.md) | 88.4% | estimated ± 1.5 pp, low confidence |
| [AIME 2025](https://benchgap.net/b/aime2025/current.md) | 98.2% | estimated ± 1.5 pp, low confidence |
| [Gert Labs](https://benchgap.net/b/gertlabs/current.md) | 57.7% | estimated ± 7.4 pp, medium confidence |
| [AA EnterpriseOps-Gym](https://benchgap.net/b/aa-enterprise-ops-gym/current.md) | 41.1% | estimated ± 3.3 pp, low confidence |
| [AA Harvey LAB v1.0](https://benchgap.net/b/aa-harvey-lab/current.md) | 88.1% | estimated ± 1.7 pp, medium confidence |
| [AA Tau3 Banking](https://benchgap.net/b/aa-tau3-banking/current.md) | 33.0% | estimated ± 3.9 pp, high confidence |
| [AA Terminal-Bench 2.1](https://benchgap.net/b/aa-terminal-bench21/current.md) | 80.0% | estimated ± 6.8 pp, medium confidence |
| [ApprenticeBench](https://benchgap.net/b/apprenticebench/current.md) | 11.4% | estimated ± 10.1 pp, low confidence |
| [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) | 89.5% | estimated ± 2.7 pp, high confidence |
| [ARC-AGI-2](https://benchgap.net/b/arc-agi-2/current.md) | 57.0% | estimated ± 10.1 pp, low confidence |
| [CursorBench 3.1](https://benchgap.net/b/cursor-bench31/current.md) | 58.4% | estimated ± 5.6 pp, low confidence |
| [CursorBench 3.2](https://benchgap.net/b/cursor-bench32/current.md) | 64.3% | estimated ± 3.6 pp, high confidence |
| [Terminal-Bench 3.0](https://benchgap.net/b/terminal-bench-3/current.md) | 12.6% | estimated ± 9.1 pp, low confidence |
| [FrontierCode 1.1 Main](https://benchgap.net/b/frontiercode/current.md) | 25.8% | estimated ± 2.7 pp, medium confidence |
| [FrontierMath v2 (Tiers 1-3)](https://benchgap.net/b/frontiermathv2tiers13/current.md) | 52.5% | estimated ± 8.8 pp, medium confidence |
| [FrontierSWE v2](https://benchgap.net/b/frontierswev2/current.md) | 25.6% | estimated ± 9.0 pp, medium confidence |
| [MazeBench](https://benchgap.net/b/mazebench/current.md) | 0.0% | estimated ± 6.1 pp, low confidence |
| [OSWorld-Verified](https://benchgap.net/b/osworld-verified/current.md) | 69.3% | estimated ± 5.8 pp, medium confidence |
| [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) | 89.6% | estimated ± 2.0 pp, high confidence |
| [Vals LiveCodeBench](https://benchgap.net/b/valslivecodebench/current.md) | 85.9% | estimated ± 0.8 pp, medium confidence |
| [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) | 86.8% | estimated ± 1.6 pp, high confidence |
| [Vals SWE-bench](https://benchgap.net/b/valsswebench/current.md) | 73.7% | estimated ± 5.3 pp, low confidence |
| [Terminal-Bench 2.1 (Vals AI)](https://benchgap.net/b/vals-terminal-bench21/current.md) | 66.9% | estimated ± 7.4 pp, medium confidence |
| [AA AutomationBench](https://benchgap.net/b/aa-automation-bench/current.md) | 44.7% | estimated ± 11.6 pp, low confidence |
| [CWE-Bench-AA](https://benchgap.net/b/aa-cwe-bench/current.md) | 52.2% | estimated ± 5.2 pp, medium confidence |
| [AA Cyber Index](https://benchgap.net/b/aa-cyber-index/current.md) | 34.3% | estimated ± 12.8 pp, low confidence |
| [DeepsecBench-AA](https://benchgap.net/b/aa-deepsec-bench/current.md) | 11.4% | estimated ± 6.0 pp, low confidence |
| [GDP.pdf](https://benchgap.net/b/aa-gdp-pdf/current.md) | 10.4% | estimated ± 4.9 pp, low confidence |
| [AA ITBench](https://benchgap.net/b/aa-itbench/current.md) | 44.3% | estimated ± 4.1 pp, high confidence |
| [AA Terminal-Bench 4.0](https://benchgap.net/b/aa-terminal-bench4/current.md) | 16.6% | estimated ± 11.6 pp, low confidence |
| [Bug Hunt Bench](https://benchgap.net/b/bug-hunt-bench/current.md) | 14.8% | estimated ± 9.4 pp, low confidence |
| [CursorBench 4.0](https://benchgap.net/b/cursor-bench40/current.md) | 40.0% | estimated ± 3.6 pp, high confidence |
| [DeepSWE](https://benchgap.net/b/deepswe/current.md) | 43.0% | measured |
| [FrontierCode 2.0](https://benchgap.net/b/frontiercode-2/current.md) | 22.5% | estimated ± 7.1 pp, low confidence |
| [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) | 36.0% | measured |
| [OSWorld 2.1](https://benchgap.net/b/osworld-2-1/current.md) | 54.6% | estimated ± 8.3 pp, low confidence |
| [PostTrainBench v1.1](https://benchgap.net/b/posttrainbench-v1-1/current.md) | 16.9% | estimated ± 4.5 pp, medium confidence |
| [SWE Multilingual](https://benchgap.net/b/swe-bench-multilingual/current.md) | 78.1% | measured |
| [Toolathlon-Verified](https://benchgap.net/b/toolathlonverified/current.md) | 66.9% | estimated ± 5.7 pp, medium confidence |
| [Vibe Code Bench](https://benchgap.net/b/vibecodebench/current.md) | 48.9% | estimated ± 8.1 pp, medium confidence |
| [ARC-AGI-3](https://benchgap.net/b/arcagi3/current.md) | 0.0% | estimated ± 3.6 pp, high confidence |
| [Hermes Bench](https://benchgap.net/b/hermesbench/current.md) | 63.9% | estimated ± 4.8 pp, low confidence |
| [Hermes Index](https://benchgap.net/b/hermesindex/current.md) | 26.4% | estimated ± 10.0 pp, low confidence |
| [ExploitGym](https://benchgap.net/b/exploitgym/current.md) | 0.0% | estimated ± 9.2 pp, low confidence |
| [Claw-Eval](https://benchgap.net/b/claw-eval/current.md) | 71.1% | estimated ± 6.3 pp, low confidence |
| [DeepPlanning](https://benchgap.net/b/deepplanning/current.md) | 50.8% | estimated ± 13.1 pp, low confidence |
| [HMMT Feb 2025](https://benchgap.net/b/hmmtfeb2025/current.md) | 98.6% | estimated ± 1.9 pp, low confidence |
| [HMMT Feb 2026](https://benchgap.net/b/hmmtfeb2026/current.md) | 93.4% | estimated ± 4.0 pp, high confidence |
| [HMMT Nov 2025](https://benchgap.net/b/hmmtnov2025/current.md) | 96.2% | estimated ± 3.2 pp, high confidence |
| [INCLUDE](https://benchgap.net/b/include/current.md) | 85.9% | estimated ± 2.0 pp, medium confidence |
| [MCP Atlas](https://benchgap.net/b/mcpatlas/current.md) | 81.5% | measured |
| [MMAnswerBench](https://benchgap.net/b/mmanswerbench/current.md) | 88.1% | estimated ± 1.3 pp, high confidence |
| [MMLU-ProX](https://benchgap.net/b/mmluprox/current.md) | 86.0% | estimated ± 1.3 pp, high confidence |
| [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) | 92.6% | estimated ± 2.8 pp, high confidence |
| [NL2Repo](https://benchgap.net/b/nl2repo/current.md) | 54.1% | estimated ± 6.1 pp, medium confidence |
| [QwenClawBench](https://benchgap.net/b/qwenclawbench/current.md) | 67.1% | estimated ± 2.6 pp, medium confidence |
| [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) | 76.9% | estimated ± 13.9 pp, low confidence |
| [Toolathlon](https://benchgap.net/b/toolathlon/current.md) | 46.2% | estimated ± 4.2 pp, high confidence |
| [HealthBench Hard](https://benchgap.net/b/healthbench-hard/current.md) | 31.9% | estimated ± 8.6 pp, low confidence |
| [LiveCodeBench Pro](https://benchgap.net/b/livecodebench-pro/current.md) | 88.1% | estimated ± 6.0 pp, low confidence |
| [MedXpertQA (Text)](https://benchgap.net/b/medxpertqatext/current.md) | 54.7% | estimated ± 4.5 pp, medium confidence |
| [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) | 87.0% | estimated ± 3.4 pp, low confidence |
| [React Native Evals](https://benchgap.net/b/reactnativeevals/current.md) | 82.0% | estimated ± 2.3 pp, medium confidence |
| [ResearchClawBench](https://benchgap.net/b/researchclawbench/current.md) | 19.2% | estimated ± 1.8 pp, medium confidence |
| [SWE-Rebench](https://benchgap.net/b/swe-rebench/current.md) | 61.8% | estimated ± 3.6 pp, medium confidence |
| [BioMysteryBench (human-solvable)](https://benchgap.net/b/biomysterybenchhumansolvable/current.md) | 88.6% | estimated ± 0.6 pp, medium confidence |
| [DRACO](https://benchgap.net/b/draco/current.md) | 81.7% | estimated ± 4.5 pp, medium confidence |
| [FrontierCode 1.1 Extended](https://benchgap.net/b/frontiercode11extended/current.md) | 57.8% | estimated ± 3.0 pp, medium confidence |
| [HealthBench Professional](https://benchgap.net/b/healthbenchprofessional/current.md) | 50.7% | estimated ± 4.8 pp, low confidence |
| [STEMBench](https://benchgap.net/b/stembench/current.md) | 2.4% | estimated ± 0.2 pp, high confidence |
| [LiveCodeBench](https://benchgap.net/b/livecodebench/current.md) | 79.4% | estimated ± 14.6 pp, low confidence |
| [Agents' Last Exam](https://benchgap.net/b/agentslastexam/current.md) | 24.2% | estimated ± 13.0 pp, low confidence |
| [OpenHarmony Bench](https://benchgap.net/b/openharmonybench/current.md) | 60.9% | estimated ± 4.9 pp, low confidence |
| [IMOAnswerBench](https://benchgap.net/b/imoanswerbench/current.md) | 75.6% | estimated ± 10.7 pp, low confidence |
| [MRCRv2](https://benchgap.net/b/mrcrv2/current.md) | 85.7% | estimated ± 11.3 pp, low confidence |
| [MMLongBench-Doc](https://benchgap.net/b/mmlongbenchdoc/current.md) | 61.4% | estimated ± 2.6 pp, low confidence |
| [PinchBench](https://benchgap.net/b/pinchbench/current.md) | 90.0% | estimated ± 3.6 pp, medium confidence |
| [SWE-Atlas Codebase QnA](https://benchgap.net/b/swe-atlas-codebase-qna/current.md) | 32.2% | measured |