# Nemotron 3.5 Lightning 30B A3B NVFP4 benchmark scores

NVIDIA · model · https://benchgap.net/model/nemotron-3-5-lightning-30b-a3b-nvfp4 · data retrieved 2026-11-22

As of 2026-11-22, Nemotron 3.5 Lightning 30B A3B NVFP4 (NVIDIA) has measured scores on 22 benchmarks and estimated scores on 77 more.

| Benchmark | Score | Source |
|---|---|---|
| [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) | 74.3% | measured |
| [AA-HLE](https://benchgap.net/b/aa-hle/current.md) | 10.6% | measured |
| [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) | 32.1% | measured |
| [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) | 5.5% | measured |
| [CritPt](https://benchgap.net/b/critpt/current.md) | 0.0% | measured |
| [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) | 6.9% | measured |
| [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) | 75.6% | measured |
| [HLE](https://benchgap.net/b/hle/current.md) | 15.5% | estimated ± 6.5 pp, medium confidence |
| [IFBench](https://benchgap.net/b/ifbench/current.md) | 72.9% | measured |
| [AA-LCR](https://benchgap.net/b/lcr/current.md) | 49.2% | measured |
| [LiveCodeBench v6](https://benchgap.net/b/livecodebench-v6/current.md) | 70.6% | estimated ± 4.4 pp, high confidence |
| [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) | 14.7% | measured |
| [SciCode](https://benchgap.net/b/scicode/current.md) | 31.4% | measured |
| [Terminal-Bench 2.1](https://benchgap.net/b/terminal-bench%23terminal-bench-2-1/current.md) | 23.5% | measured |
| [BrowseComp](https://benchgap.net/b/browsecomp/current.md) | 36.8% | measured |
| [HLE w/ tools](https://benchgap.net/b/hlewithtools/current.md) | 37.1% | estimated ± 5.3 pp, low confidence |
| [IFEval](https://benchgap.net/b/ifeval/current.md) | 93.3% | estimated ± 3.6 pp, high confidence |
| [LongBench v2](https://benchgap.net/b/longbench-v2/current.md) | 52.1% | estimated ± 5.5 pp, medium confidence |
| [VITA-Bench](https://benchgap.net/b/vitabench/current.md) | 6.8% | estimated ± 6.7 pp, low confidence |
| [τ²-bench results](https://benchgap.net/b/tau2-bench/current.md) | 44.1% | estimated ± 11.8 pp, low confidence |
| [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) | 26.8% | measured |
| [APEX-Agents](https://benchgap.net/b/apexagents/current.md) | 4.5% | estimated ± 9.4 pp, low confidence |
| [APEX-Agents-AA](https://benchgap.net/b/apexagentsaa/current.md) | 7.0% | estimated ± 4.4 pp, medium confidence |
| [BioMysteryBench (human-difficult)](https://benchgap.net/b/biomysterybenchhumandifficult/current.md) | 0.0% | estimated ± 6.8 pp, low confidence |
| [DeepSearchQA](https://benchgap.net/b/deepsearchqa/current.md) | 61.7% | estimated ± 4.5 pp, medium confidence |
| [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) | 52.8% | measured |
| [AutomationBench](https://benchgap.net/b/automationbench/current.md) | 30.1% | estimated ± 9.1 pp, low confidence |
| [BFCL v4](https://benchgap.net/b/bfcl-v4/current.md) | 65.1% | estimated ± 2.7 pp, high confidence |
| [CyberGym](https://benchgap.net/b/cybergym/current.md) | 50.3% | estimated ± 5.3 pp, low confidence |
| [JobBench](https://benchgap.net/b/jobbench/current.md) | 0.0% | estimated ± 8.7 pp, low confidence |
| [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) | 28.4% | estimated ± 4.5 pp, high confidence |
| [τ³-bench results](https://benchgap.net/b/tau3-bench/current.md) | 9.5% | measured |
| [WideResearch](https://benchgap.net/b/wideresearch/current.md) | 49.4% | estimated ± 3.5 pp, medium confidence |
| [AA Agentic Index](https://benchgap.net/b/aa-agentic-index/current.md) | 6.1% | measured |
| [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) | 81.6% | measured |
| [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) | 58.1% | estimated ± 7.4 pp, medium confidence |
| [BBH](https://benchgap.net/b/bbh/current.md) | 96.9% | estimated ± 2.8 pp, medium confidence |
| [GPQA](https://benchgap.net/b/gpqa/current.md) | 75.6% | measured |
| [MMLU](https://benchgap.net/b/mmlu/current.md) | 80.3% | estimated ± 0.9 pp, high confidence |
| [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) | 75.7% | estimated ± 2.1 pp, medium confidence |
| [Vals LiveCodeBench](https://benchgap.net/b/valslivecodebench/current.md) | 81.8% | estimated ± 0.8 pp, low confidence |
| [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) | 78.2% | estimated ± 1.6 pp, medium confidence |
| [MMMLU](https://benchgap.net/b/mmmlu/current.md) | 83.3% | estimated ± 0.7 pp, medium confidence |
| [AA MMLU-Pro](https://benchgap.net/b/aa-mmlu-pro/current.md) | 83.3% | estimated ± 0.8 pp, medium confidence |
| [Gert Labs](https://benchgap.net/b/gertlabs/current.md) | 27.3% | estimated ± 10.0 pp, low confidence |
| [AA Harvey LAB v1.0](https://benchgap.net/b/aa-harvey-lab/current.md) | 79.4% | estimated ± 1.2 pp, low confidence |
| [AA Tau3 Banking](https://benchgap.net/b/aa-tau3-banking/current.md) | 19.5% | estimated ± 3.7 pp, medium confidence |
| [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) | 14.0% | estimated ± 3.9 pp, medium confidence |
| [ARC-AGI-2](https://benchgap.net/b/arc-agi-2/current.md) | 0.0% | estimated ± 10.9 pp, low confidence |
| [FrontierSWE v2](https://benchgap.net/b/frontierswev2/current.md) | 1.5% | estimated ± 14.2 pp, low confidence |
| [MazeBench](https://benchgap.net/b/mazebench/current.md) | 0.4% | estimated ± 5.5 pp, low confidence |
| [OSWorld-Verified](https://benchgap.net/b/osworld-verified/current.md) | 49.6% | estimated ± 5.7 pp, low confidence |
| [Vals SWE-bench](https://benchgap.net/b/valsswebench/current.md) | 38.4% | estimated ± 5.3 pp, low confidence |
| [Terminal-Bench 2.1 (Vals AI)](https://benchgap.net/b/vals-terminal-bench21/current.md) | 24.8% | estimated ± 7.3 pp, low confidence |
| [CWE-Bench-AA](https://benchgap.net/b/aa-cwe-bench/current.md) | 27.0% | estimated ± 6.4 pp, low confidence |
| [AA Cyber Index](https://benchgap.net/b/aa-cyber-index/current.md) | 4.5% | estimated ± 9.2 pp, low confidence |
| [DeepsecBench-AA](https://benchgap.net/b/aa-deepsec-bench/current.md) | 0.0% | estimated ± 8.9 pp, low confidence |
| [HealthBench Professional (raw, Artificial Analysis)](https://benchgap.net/b/aa-health-bench-professional-raw/current.md) | 4.3% | estimated ± 2.5 pp, low confidence |
| [AA ITBench](https://benchgap.net/b/aa-itbench/current.md) | 34.8% | estimated ± 4.0 pp, medium confidence |
| [Bug Hunt Bench](https://benchgap.net/b/bug-hunt-bench/current.md) | 10.2% | estimated ± 10.5 pp, low confidence |
| [CWE-bench v1](https://benchgap.net/b/cwe-bench%23cwe-bench-v1/current.md) | 11.5% | estimated ± 6.4 pp, low confidence |
| [DeepSWE](https://benchgap.net/b/deepswe/current.md) | 12.0% | estimated ± 7.5 pp, low confidence |
| [DRACO](https://benchgap.net/b/draco/current.md) | 42.1% | estimated ± 2.0 pp, low confidence |
| [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) | 10.5% | measured |
| [SWE Multilingual](https://benchgap.net/b/swe-bench-multilingual/current.md) | 36.5% | measured |
| [Toolathlon-Verified](https://benchgap.net/b/toolathlonverified/current.md) | 20.8% | estimated ± 2.3 pp, low confidence |
| [VulcanBench Frontier v4](https://benchgap.net/b/vulcanbench/current.md) | 60.1% | estimated ± 6.8 pp, low confidence |
| [GDP.pdf](https://benchgap.net/b/aa-gdp-pdf/current.md) | 17.0% | estimated ± 4.6 pp, medium confidence |
| [ARC-AGI-3](https://benchgap.net/b/arcagi3/current.md) | 0.0% | estimated ± 7.2 pp, low confidence |
| [ARC-AGI-3 Provider Adapter](https://benchgap.net/b/arc-agi-3-provider-adapter/current.md) | 2.7% | estimated ± 7.3 pp, low confidence |
| [Vibe Code Bench](https://benchgap.net/b/vibecodebench/current.md) | 0.0% | estimated ± 8.4 pp, low confidence |
| [Hermes Bench](https://benchgap.net/b/hermesbench/current.md) | 26.9% | estimated ± 2.9 pp, medium confidence |
| [Hermes Index](https://benchgap.net/b/hermesindex/current.md) | 6.9% | estimated ± 8.7 pp, low confidence |
| [ExploitGym](https://benchgap.net/b/exploitgym/current.md) | 0.0% | estimated ± 10.6 pp, low confidence |
| [C-Eval](https://benchgap.net/b/ceval/current.md) | 87.2% | estimated ± 1.0 pp, low confidence |
| [Claw-Eval](https://benchgap.net/b/claw-eval/current.md) | 62.7% | estimated ± 6.4 pp, low confidence |
| [MCP Atlas](https://benchgap.net/b/mcpatlas/current.md) | 64.6% | estimated ± 7.8 pp, low confidence |
| [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) | 91.3% | estimated ± 0.6 pp, high confidence |
| [NL2Repo](https://benchgap.net/b/nl2repo/current.md) | 17.0% | estimated ± 4.7 pp, medium confidence |
| [QwenClawBench](https://benchgap.net/b/qwenclawbench/current.md) | 55.9% | estimated ± 6.0 pp, low confidence |
| [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) | 55.6% | estimated ± 8.5 pp, low confidence |
| [Toolathlon](https://benchgap.net/b/toolathlon/current.md) | 16.7% | estimated ± 4.2 pp, medium confidence |
| [AA LiveCodeBench](https://benchgap.net/b/aa-live-code-bench/current.md) | 84.0% | estimated ± 4.7 pp, low confidence |
| [HealthBench Hard](https://benchgap.net/b/healthbench-hard/current.md) | 0.0% | estimated ± 8.6 pp, low confidence |
| [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) | 81.4% | estimated ± 3.4 pp, medium confidence |
| [React Native Evals](https://benchgap.net/b/reactnativeevals/current.md) | 67.4% | estimated ± 2.7 pp, low confidence |
| [ResearchClawBench](https://benchgap.net/b/researchclawbench/current.md) | 8.9% | estimated ± 1.9 pp, medium confidence |
| [BioMysteryBench (human-solvable)](https://benchgap.net/b/biomysterybenchhumansolvable/current.md) | 81.7% | estimated ± 0.6 pp, low confidence |
| [HealthBench (length-adjusted)](https://benchgap.net/b/healthbenchlengthadjusted/current.md) | 54.1% | estimated ± 3.7 pp, medium confidence |
| [HealthBench Professional](https://benchgap.net/b/healthbenchprofessional/current.md) | 56.7% | estimated ± 4.2 pp, low confidence |
| [ScarfBench](https://benchgap.net/b/scarfbench/current.md) | 24.4% | estimated ± 9.1 pp, low confidence |
| [STEMBench](https://benchgap.net/b/stembench/current.md) | 2.3% | estimated ± 0.2 pp, low confidence |
| [SimpleQA](https://benchgap.net/b/simpleqa/current.md) | 10.8% | estimated ± 4.3 pp, low confidence |
| [LiveCodeBench](https://benchgap.net/b/livecodebench/current.md) | 60.5% | estimated ± 14.6 pp, low confidence |
| [OpenHarmony Bench v1.0](https://benchgap.net/b/openharmonybench%23openharmonybench-v1-0/current.md) | 51.0% | estimated ± 2.4 pp, medium confidence |
| [MRCRv2](https://benchgap.net/b/mrcrv2/current.md) | 22.9% | estimated ± 11.3 pp, low confidence |
| [MMLongBench-Doc](https://benchgap.net/b/mmlongbenchdoc/current.md) | 59.3% | estimated ± 2.6 pp, low confidence |
| [BioBasicsBench](https://benchgap.net/b/biobasicsbench/current.md) | 7.2% | estimated ± 10.2 pp, low confidence |
| [PinchBench](https://benchgap.net/b/pinchbench/current.md) | 83.4% | measured |
