# Mercury 3 benchmark scores

Other · model · https://benchgap.net/model/mercury-3 · data retrieved 2026-10-29

As of 2026-10-29, Mercury 3 (Other) has measured scores on 6 benchmarks and estimated scores on 41 more.

| Benchmark | Score | Source |
|---|---|---|
| [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) | 88.6% | estimated ± 4.4 pp, high confidence |
| [AA-HLE](https://benchgap.net/b/aa-hle/current.md) | 33.1% | estimated ± 3.8 pp, high confidence |
| [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) | 50.5% | estimated ± 3.5 pp, medium confidence |
| [CritPt](https://benchgap.net/b/critpt/current.md) | 9.9% | estimated ± 4.6 pp, high confidence |
| [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) | 24.1% | estimated ± 12.2 pp, low confidence |
| [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) | 89.2% | measured |
| [HLE](https://benchgap.net/b/hle/current.md) | 35.9% | estimated ± 7.3 pp, medium confidence |
| [IFBench](https://benchgap.net/b/ifbench/current.md) | 76.8% | measured |
| [AA-LCR](https://benchgap.net/b/lcr/current.md) | 73.5% | estimated ± 3.4 pp, high confidence |
| [BrowseComp](https://benchgap.net/b/browsecomp/current.md) | 76.1% | estimated ± 6.7 pp, low confidence |
| [IFEval](https://benchgap.net/b/ifeval/current.md) | 94.1% | estimated ± 3.6 pp, high confidence |
| [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) | 68.9% | estimated ± 2.5 pp, high confidence |
| [APEX-Agents-AA](https://benchgap.net/b/apexagentsaa/current.md) | 25.2% | estimated ± 11.5 pp, low confidence |
| [DeepSearchQA](https://benchgap.net/b/deepsearchqa/current.md) | 71.3% | measured |
| [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) | 80.6% | estimated ± 4.6 pp, high confidence |
| [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) | 61.5% | estimated ± 7.5 pp, low confidence |
| [τ³-bench results](https://benchgap.net/b/tau3-bench/current.md) | 30.2% | measured |
| [AA Agentic Index](https://benchgap.net/b/aa-agentic-index/current.md) | 4.9% | estimated ± 5.9 pp, medium confidence |
| [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) | 87.1% | estimated ± 5.5 pp, medium confidence |
| [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) | 78.8% | estimated ± 7.4 pp, medium confidence |
| [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) | 27.3% | estimated ± 10.6 pp, low confidence |
| [GPQA](https://benchgap.net/b/gpqa/current.md) | 89.1% | estimated ± 1.2 pp, high confidence |
| [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) | 32.5% | estimated ± 8.7 pp, medium confidence |
| [MMMLU](https://benchgap.net/b/mmmlu/current.md) | 89.5% | estimated ± 1.1 pp, medium confidence |
| [Gert Labs](https://benchgap.net/b/gertlabs/current.md) | 58.9% | estimated ± 11.2 pp, low confidence |
| [ApprenticeBench](https://benchgap.net/b/apprenticebench/current.md) | 6.7% | estimated ± 10.1 pp, low confidence |
| [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) | 87.8% | estimated ± 2.7 pp, high confidence |
| [ARC-AGI-2](https://benchgap.net/b/arc-agi-2/current.md) | 52.7% | estimated ± 10.1 pp, low confidence |
| [CursorBench 3.2](https://benchgap.net/b/cursor-bench32/current.md) | 53.4% | estimated ± 6.4 pp, low confidence |
| [OSWorld-Verified](https://benchgap.net/b/osworld-verified/current.md) | 68.3% | estimated ± 7.1 pp, low confidence |
| [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) | 88.5% | estimated ± 2.0 pp, high confidence |
| [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) | 86.2% | estimated ± 1.6 pp, high confidence |
| [Bug Hunt Bench](https://benchgap.net/b/bug-hunt-bench/current.md) | 15.6% | estimated ± 9.4 pp, low confidence |
| [DeepSWE](https://benchgap.net/b/deepswe/current.md) | 46.3% | measured |
| [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) | 32.8% | estimated ± 4.3 pp, high confidence |
| [PostTrainBench v1.1](https://benchgap.net/b/posttrainbench-v1-1/current.md) | 18.9% | estimated ± 4.5 pp, medium confidence |
| [ARC-AGI-3](https://benchgap.net/b/arcagi3/current.md) | 0.0% | estimated ± 3.6 pp, high confidence |
| [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) | 92.5% | estimated ± 2.8 pp, high confidence |
| [NL2Repo](https://benchgap.net/b/nl2repo/current.md) | 50.6% | estimated ± 6.2 pp, medium confidence |
| [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) | 75.1% | estimated ± 13.9 pp, low confidence |
| [MedXpertQA (Text)](https://benchgap.net/b/medxpertqatext/current.md) | 51.6% | estimated ± 4.5 pp, medium confidence |
| [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) | 86.6% | estimated ± 3.4 pp, low confidence |
| [ResearchClawBench](https://benchgap.net/b/researchclawbench/current.md) | 15.3% | estimated ± 2.9 pp, low confidence |
| [HealthBench Professional](https://benchgap.net/b/healthbenchprofessional/current.md) | 48.7% | estimated ± 4.8 pp, low confidence |
| [MRCRv2](https://benchgap.net/b/mrcrv2/current.md) | 75.5% | measured |
| [PinchBench](https://benchgap.net/b/pinchbench/current.md) | 91.5% | estimated ± 5.5 pp, low confidence |
| [SWE-Atlas Codebase QnA](https://benchgap.net/b/swe-atlas-codebase-qna/current.md) | 39.8% | estimated ± 5.4 pp, low confidence |
