# LFM3-1.7B benchmark scores

Other · model · https://benchgap.net/model/lfm3-1-7b · data retrieved 2026-10-29

As of 2026-10-29, LFM3-1.7B (Other) has measured scores on 19 benchmarks and estimated scores on 55 more.

| Benchmark | Score | Source |
|---|---|---|
| [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) | 65.8% | estimated ± 3.0 pp, medium confidence |
| [AA-HLE](https://benchgap.net/b/aa-hle/current.md) | 5.7% | estimated ± 3.8 pp, high confidence |
| [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) | 29.5% | estimated ± 3.0 pp, high confidence |
| [CritPt](https://benchgap.net/b/critpt/current.md) | 0.4% | estimated ± 4.0 pp, high confidence |
| [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) | 19.0% | estimated ± 5.5 pp, medium confidence |
| [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) | 63.4% | measured |
| [HLE](https://benchgap.net/b/hle/current.md) | 7.2% | measured |
| [IFBench](https://benchgap.net/b/ifbench/current.md) | 73.0% | measured |
| [AA-LCR](https://benchgap.net/b/lcr/current.md) | 52.8% | measured |
| [LiveCodeBench v6](https://benchgap.net/b/livecodebench-v6/current.md) | 73.5% | measured |
| [SciCode](https://benchgap.net/b/scicode/current.md) | 28.5% | measured |
| [Terminal-Bench 2.1](https://benchgap.net/b/terminalbench21/current.md) | 12.9% | measured |
| [BrowseComp](https://benchgap.net/b/browsecomp/current.md) | 88.9% | estimated ± 7.0 pp, low confidence |
| [HLE w/ tools](https://benchgap.net/b/hlewithtools/current.md) | 13.9% | measured |
| [IFEval](https://benchgap.net/b/ifeval/current.md) | 96.7% | measured |
| [LongBench v2](https://benchgap.net/b/longbench-v2/current.md) | 57.0% | estimated ± 5.8 pp, low confidence |
| [VITA-Bench](https://benchgap.net/b/vitabench/current.md) | 24.7% | estimated ± 9.9 pp, low confidence |
| [τ²-bench results](https://benchgap.net/b/tau2-bench/current.md) | 1.7% | estimated ± 3.1 pp, medium confidence |
| [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) | 23.8% | estimated ± 5.3 pp, medium confidence |
| [APEX-Agents](https://benchgap.net/b/apexagents/current.md) | 0.0% | estimated ± 0.6 pp, low confidence |
| [APEX-Agents-AA](https://benchgap.net/b/apexagentsaa/current.md) | 11.0% | estimated ± 5.5 pp, medium confidence |
| [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) | 43.4% | measured |
| [AutomationBench](https://benchgap.net/b/automationbench/current.md) | 41.3% | measured |
| [BFCL v4](https://benchgap.net/b/bfcl-v4/current.md) | 71.4% | measured |
| [CyberGym](https://benchgap.net/b/cybergym/current.md) | 84.8% | estimated ± 4.6 pp, medium confidence |
| [JobBench](https://benchgap.net/b/jobbench/current.md) | 14.7% | estimated ± 6.4 pp, medium confidence |
| [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) | 17.8% | estimated ± 4.6 pp, medium confidence |
| [τ³-bench results](https://benchgap.net/b/tau3-bench/current.md) | 68.0% | measured |
| [WideResearch](https://benchgap.net/b/wideresearch/current.md) | 49.2% | estimated ± 4.8 pp, low confidence |
| [AA Agentic Index](https://benchgap.net/b/aa-agentic-index/current.md) | 18.4% | estimated ± 5.9 pp, medium confidence |
| [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) | 6.0% | estimated ± 4.6 pp, medium confidence |
| [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) | 58.4% | estimated ± 7.4 pp, medium confidence |
| [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) | 10.7% | estimated ± 6.3 pp, medium confidence |
| [GPQA](https://benchgap.net/b/gpqa/current.md) | 63.4% | measured |
| [MMLU](https://benchgap.net/b/mmlu/current.md) | 66.9% | estimated ± 1.0 pp, medium confidence |
| [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) | 7.1% | measured |
| [MMMLU](https://benchgap.net/b/mmmlu/current.md) | 80.0% | estimated ± 1.7 pp, high confidence |
| [AA MMLU-Pro](https://benchgap.net/b/aa-mmlu-pro/current.md) | 82.0% | estimated ± 0.7 pp, medium confidence |
| [Gert Labs](https://benchgap.net/b/gertlabs/current.md) | 48.4% | estimated ± 8.2 pp, low confidence |
| [AA Harvey LAB v1.0](https://benchgap.net/b/aa-harvey-lab/current.md) | 56.2% | estimated ± 1.7 pp, low confidence |
| [AA Tau3 Banking](https://benchgap.net/b/aa-tau3-banking/current.md) | 46.1% | estimated ± 3.8 pp, medium confidence |
| [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) | 28.4% | estimated ± 7.6 pp, low confidence |
| [OSWorld-Verified](https://benchgap.net/b/osworld-verified/current.md) | 72.4% | estimated ± 3.8 pp, medium confidence |
| [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) | 73.0% | estimated ± 8.5 pp, low confidence |
| [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) | 80.6% | estimated ± 2.4 pp, medium confidence |
| [Vals SWE-bench](https://benchgap.net/b/valsswebench/current.md) | 26.0% | estimated ± 6.8 pp, low confidence |
| [CWE-Bench-AA](https://benchgap.net/b/aa-cwe-bench/current.md) | 6.4% | estimated ± 5.2 pp, low confidence |
| [AA Cyber Index](https://benchgap.net/b/aa-cyber-index/current.md) | 33.9% | estimated ± 9.4 pp, medium confidence |
| [DeepsecBench-AA](https://benchgap.net/b/aa-deepsec-bench/current.md) | 0.0% | estimated ± 7.4 pp, low confidence |
| [AA ITBench](https://benchgap.net/b/aa-itbench/current.md) | 21.5% | estimated ± 4.4 pp, medium confidence |
| [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) | 9.5% | estimated ± 4.3 pp, medium confidence |
| [SWE Multilingual](https://benchgap.net/b/swe-bench-multilingual/current.md) | 23.0% | measured |
| [Toolathlon-Verified](https://benchgap.net/b/toolathlonverified/current.md) | 24.0% | estimated ± 5.7 pp, low confidence |
| [Vibe Code Bench](https://benchgap.net/b/vibecodebench/current.md) | 0.6% | estimated ± 8.1 pp, low confidence |
| [C-Eval](https://benchgap.net/b/ceval/current.md) | 86.6% | estimated ± 1.2 pp, high confidence |
| [Claw-Eval](https://benchgap.net/b/claw-eval/current.md) | 68.6% | measured |
| [DeepPlanning](https://benchgap.net/b/deepplanning/current.md) | 32.9% | estimated ± 8.3 pp, low confidence |
| [MCP Atlas](https://benchgap.net/b/mcpatlas/current.md) | 32.6% | measured |
| [MCP-Tasks](https://benchgap.net/b/mcptasks/current.md) | 62.7% | estimated ± 0.6 pp, medium confidence |
| [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) | 91.9% | estimated ± 0.8 pp, low confidence |
| [NL2Repo](https://benchgap.net/b/nl2repo/current.md) | 21.4% | estimated ± 3.4 pp, medium confidence |
| [QwenClawBench](https://benchgap.net/b/qwenclawbench/current.md) | 53.2% | estimated ± 2.6 pp, high confidence |
| [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) | 50.0% | estimated ± 6.9 pp, medium confidence |
| [Toolathlon](https://benchgap.net/b/toolathlon/current.md) | 36.3% | estimated ± 7.5 pp, medium confidence |
| [LiveCodeBench Pro](https://benchgap.net/b/livecodebench-pro/current.md) | 31.7% | measured |
| [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) | 75.7% | estimated ± 3.4 pp, medium confidence |
| [React Native Evals](https://benchgap.net/b/reactnativeevals/current.md) | 71.4% | estimated ± 2.3 pp, low confidence |
| [ResearchClawBench](https://benchgap.net/b/researchclawbench/current.md) | 19.4% | estimated ± 1.3 pp, high confidence |
| [STEMBench](https://benchgap.net/b/stembench/current.md) | 2.2% | estimated ± 0.2 pp, low confidence |
| [SimpleQA](https://benchgap.net/b/simpleqa/current.md) | 0.3% | estimated ± 4.3 pp, low confidence |
| [LiveCodeBench](https://benchgap.net/b/livecodebench/current.md) | 52.5% | estimated ± 14.6 pp, low confidence |
| [MRCRv2](https://benchgap.net/b/mrcrv2/current.md) | 23.1% | estimated ± 11.3 pp, low confidence |
| [MMLongBench-Doc](https://benchgap.net/b/mmlongbenchdoc/current.md) | 59.7% | estimated ± 2.6 pp, low confidence |
| [PinchBench](https://benchgap.net/b/pinchbench/current.md) | 99.0% | estimated ± 5.0 pp, low confidence |