# LFM2.5-24B-A2B benchmark scores

Other · model · https://benchgap.net/model/lfm2-5-24b-a2b · data retrieved 2026-10-29

As of 2026-10-29, LFM2.5-24B-A2B (Other) has measured scores on 12 benchmarks and estimated scores on 40 more.

| Benchmark | Score | Source |
|---|---|---|
| [AA-GPQA Diamond](https://benchgap.net/b/aa-gpqa-diamond/current.md) | 66.4% | estimated ± 3.0 pp, medium confidence |
| [AA-HLE](https://benchgap.net/b/aa-hle/current.md) | 12.6% | estimated ± 3.8 pp, high confidence |
| [AA-SciCode](https://benchgap.net/b/aa-sci-code/current.md) | 33.4% | estimated ± 3.0 pp, high confidence |
| [CritPt](https://benchgap.net/b/critpt/current.md) | 0.4% | estimated ± 4.0 pp, high confidence |
| [GDPval-AA](https://benchgap.net/b/gdpvalaanormalized/current.md) | 11.7% | estimated ± 5.5 pp, medium confidence |
| [GPQA Diamond](https://benchgap.net/b/gpqa-diamond/current.md) | 74.4% | measured |
| [HLE](https://benchgap.net/b/hle/current.md) | 7.4% | measured |
| [IFBench](https://benchgap.net/b/ifbench/current.md) | 74.7% | measured |
| [LiveCodeBench v6](https://benchgap.net/b/livecodebench-v6/current.md) | 71.7% | estimated ± 4.4 pp, high confidence |
| [SciCode](https://benchgap.net/b/scicode/current.md) | 32.7% | measured |
| [BrowseComp](https://benchgap.net/b/browsecomp/current.md) | 84.4% | estimated ± 7.0 pp, low confidence |
| [IFEval](https://benchgap.net/b/ifeval/current.md) | 96.8% | measured |
| [τ²-bench results](https://benchgap.net/b/tau2-bench/current.md) | 86.8% | estimated ± 12.4 pp, low confidence |
| [AA Coding Index](https://benchgap.net/b/aa-coding-index/current.md) | 24.7% | estimated ± 5.3 pp, medium confidence |
| [SWE-bench Verified](https://benchgap.net/b/swe-bench-verified/current.md) | 51.0% | measured |
| [AutomationBench](https://benchgap.net/b/automationbench/current.md) | 27.7% | measured |
| [BFCL v4](https://benchgap.net/b/bfcl-v4/current.md) | 65.0% | measured |
| [CyberGym](https://benchgap.net/b/cybergym/current.md) | 79.0% | estimated ± 4.6 pp, medium confidence |
| [SWE-bench Pro](https://benchgap.net/b/swe-bench-pro/current.md) | 26.3% | estimated ± 4.6 pp, high confidence |
| [τ³-bench results](https://benchgap.net/b/tau3-bench/current.md) | 8.0% | measured |
| [AA Agentic Index](https://benchgap.net/b/aa-agentic-index/current.md) | 4.9% | estimated ± 5.9 pp, low confidence |
| [MMLU-Pro](https://benchgap.net/b/mmlu-pro/current.md) | 78.3% | estimated ± 5.5 pp, medium confidence |
| [AA-IFBench](https://benchgap.net/b/aa-if-bench/current.md) | 66.8% | estimated ± 7.4 pp, medium confidence |
| [AIME 2024](https://benchgap.net/b/aime2024/current.md) | 74.3% | estimated ± 8.2 pp, medium confidence |
| [Artificial Analysis Intelligence Index](https://benchgap.net/b/artificialanalysis/current.md) | 12.0% | estimated ± 6.3 pp, medium confidence |
| [GPQA](https://benchgap.net/b/gpqa/current.md) | 74.4% | measured |
| [MMLU](https://benchgap.net/b/mmlu/current.md) | 87.9% | estimated ± 4.3 pp, high confidence |
| [AA-Omniscience Accuracy](https://benchgap.net/b/omniscienceaccuracy/current.md) | 22.0% | estimated ± 8.1 pp, medium confidence |
| [MATH-500](https://benchgap.net/b/math-500/current.md) | 96.0% | measured |
| [MMMLU](https://benchgap.net/b/mmmlu/current.md) | 79.8% | estimated ± 1.1 pp, low confidence |
| [AA MMLU-Pro](https://benchgap.net/b/aa-mmlu-pro/current.md) | 85.3% | estimated ± 1.0 pp, low confidence |
| [AIME 2025](https://benchgap.net/b/aime2025/current.md) | 69.3% | estimated ± 14.2 pp, low confidence |
| [AA Tau3 Banking](https://benchgap.net/b/aa-tau3-banking/current.md) | 41.8% | estimated ± 3.8 pp, medium confidence |
| [ARC-AGI-1](https://benchgap.net/b/arcagi1/current.md) | 29.3% | estimated ± 7.0 pp, low confidence |
| [ARC-AGI-2](https://benchgap.net/b/arc-agi-2/current.md) | 0.0% | estimated ± 11.6 pp, low confidence |
| [Vals GPQA Diamond](https://benchgap.net/b/vals-gpqa-diamond/current.md) | 62.0% | estimated ± 4.8 pp, medium confidence |
| [Vals LiveCodeBench](https://benchgap.net/b/valslivecodebench/current.md) | 82.1% | estimated ± 0.8 pp, low confidence |
| [Vals MMLU-Pro](https://benchgap.net/b/vals-mmlu-pro/current.md) | 44.5% | estimated ± 1.2 pp, medium confidence |
| [Vals SWE-bench](https://benchgap.net/b/valsswebench/current.md) | 43.4% | estimated ± 5.3 pp, low confidence |
| [CWE-Bench-AA](https://benchgap.net/b/aa-cwe-bench/current.md) | 55.7% | estimated ± 6.0 pp, low confidence |
| [AA Cyber Index](https://benchgap.net/b/aa-cyber-index/current.md) | 32.8% | estimated ± 9.4 pp, low confidence |
| [HLE w/o tools](https://benchgap.net/b/hlenotools/current.md) | 10.5% | estimated ± 4.3 pp, medium confidence |
| [Vibe Code Bench](https://benchgap.net/b/vibecodebench/current.md) | 0.6% | estimated ± 8.1 pp, low confidence |
| [C-Eval](https://benchgap.net/b/ceval/current.md) | 89.6% | estimated ± 1.2 pp, high confidence |
| [MCP Atlas](https://benchgap.net/b/mcpatlas/current.md) | 35.9% | estimated ± 14.2 pp, low confidence |
| [MMLU-Redux](https://benchgap.net/b/mmluredux/current.md) | 91.6% | estimated ± 1.7 pp, high confidence |
| [SuperGPQA](https://benchgap.net/b/supergpqa/current.md) | 50.2% | estimated ± 6.9 pp, medium confidence |
| [MMLU-Pro (Arcee)](https://benchgap.net/b/mmlu-pro-arcee/current.md) | 80.9% | estimated ± 3.4 pp, medium confidence |
| [React Native Evals](https://benchgap.net/b/reactnativeevals/current.md) | 71.4% | estimated ± 2.3 pp, low confidence |
| [SimpleQA](https://benchgap.net/b/simpleqa/current.md) | 34.7% | estimated ± 14.6 pp, low confidence |
| [LiveCodeBench](https://benchgap.net/b/livecodebench/current.md) | 59.0% | estimated ± 14.6 pp, low confidence |
| [PinchBench](https://benchgap.net/b/pinchbench/current.md) | 83.2% | measured |