benchgap
Other · model

LFM2.5-2.6B benchmark scores

As of 2026-11-22, LFM2.5-2.6B (Other) has measured scores on 14 benchmarks and estimated scores on 72 more.

BenchmarkScoreSource
AA-GPQA Diamond55.8%measured
AA-HLE6.2%measured
AA-SciCode14.4%measured
AIME2654.7%estimated ± 4.3 pp, medium confidence
Artificial Analysis Intelligence Index12.6%estimated ± 7.2 pp, medium confidence
CritPt0.0%measured
GDPval-AA0.0%measured
GPQA Diamond70.4%estimated ± 2.4 pp, high confidence
HLE17.2%estimated ± 8.5 pp, medium confidence
IFBench59.2%measured
AA-LCR5.7%measured
LiveCodeBench v659.4%measured
AA-Omniscience Accuracy18.6%estimated ± 7.7 pp, medium confidence
SciCode15.3%estimated ± 3.1 pp, medium confidence
BrowseComp0.0%estimated ± 9.2 pp, low confidence
HLE w/ tools33.8%estimated ± 5.3 pp, low confidence
IFEval88.3%estimated ± 3.6 pp, high confidence
LongBench v251.2%estimated ± 5.5 pp, low confidence
VITA-Bench40.1%estimated ± 10.7 pp, low confidence
τ²-bench results80.3%estimated ± 12.4 pp, low confidence
AA Coding Index7.7%measured
APEX-Agents0.0%estimated ± 9.4 pp, low confidence
APEX-Agents-AA6.0%estimated ± 9.5 pp, medium confidence
BioMysteryBench (human-difficult)0.0%estimated ± 6.8 pp, low confidence
DeepSearchQA34.7%estimated ± 9.6 pp, medium confidence
SWE-bench Verified29.0%estimated ± 6.3 pp, low confidence
AutomationBench23.2%estimated ± 9.1 pp, low confidence
BFCL v456.9%measured
CyberGym0.0%estimated ± 6.0 pp, low confidence
JobBench0.0%estimated ± 8.7 pp, low confidence
SWE-bench Pro0.0%estimated ± 6.0 pp, low confidence
τ³-bench results5.7%measured
WideResearch0.0%estimated ± 7.8 pp, low confidence
AA Agentic Index0.0%estimated ± 3.1 pp, high confidence
MMLU-Pro76.1%estimated ± 7.0 pp, medium confidence
AA-IFBench56.7%estimated ± 7.4 pp, medium confidence
AIME 202466.6%estimated ± 2.6 pp, high confidence
GPQA59.5%estimated ± 6.1 pp, medium confidence
MMLU86.7%estimated ± 8.3 pp, medium confidence
Vals GPQA Diamond54.9%estimated ± 3.2 pp, high confidence
Vals LiveCodeBench44.6%estimated ± 5.7 pp, low confidence
Vals MMLU-Pro72.4%estimated ± 3.0 pp, high confidence
MATH-50093.7%estimated ± 2.0 pp, high confidence
MMMLU83.3%estimated ± 0.7 pp, medium confidence
AIME 202551.9%measured
AA MMLU-Pro85.7%estimated ± 1.3 pp, medium confidence
Gert Labs26.9%estimated ± 10.0 pp, low confidence
AA Tau3 Banking0.0%estimated ± 4.1 pp, medium confidence
ARC-AGI-174.7%estimated ± 7.8 pp, low confidence
ARC-AGI-230.5%estimated ± 14.4 pp, low confidence
MazeBench0.4%estimated ± 5.5 pp, low confidence
OSWorld-Verified70.6%estimated ± 3.8 pp, medium confidence
Vals SWE-bench29.7%estimated ± 5.5 pp, low confidence
CWE-Bench-AA0.0%estimated ± 10.1 pp, low confidence
DeepsecBench-AA0.0%estimated ± 8.9 pp, low confidence
AA ITBench35.7%estimated ± 5.1 pp, low confidence
CWE-bench v10.0%estimated ± 6.4 pp, low confidence
DRACO0.0%estimated ± 2.0 pp, low confidence
HLE w/o tools4.7%estimated ± 5.4 pp, low confidence
Toolathlon-Verified0.0%estimated ± 3.1 pp, medium confidence
GDP.pdf17.0%estimated ± 4.6 pp, medium confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
Vibe Code Bench1.8%estimated ± 10.0 pp, low confidence
Hermes Bench0.0%estimated ± 2.9 pp, medium confidence
Hermes Index0.0%estimated ± 8.7 pp, low confidence
C-Eval90.8%estimated ± 1.1 pp, low confidence
Claw-Eval62.8%measured
HMMT Feb 202626.7%estimated ± 11.0 pp, low confidence
MCP Atlas56.5%estimated ± 10.7 pp, low confidence
MCP-Tasks78.6%estimated ± 6.4 pp, low confidence
MMLU-Redux86.7%estimated ± 3.3 pp, medium confidence
NL2Repo0.0%estimated ± 7.4 pp, low confidence
QwenClawBench55.9%estimated ± 6.0 pp, low confidence
Toolathlon27.0%estimated ± 6.3 pp, low confidence
HealthBench Hard0.0%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
React Native Evals66.0%estimated ± 3.2 pp, medium confidence
ResearchClawBench17.1%estimated ± 1.3 pp, high confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
ScarfBench24.4%estimated ± 9.1 pp, low confidence
SimpleQA16.4%estimated ± 7.8 pp, medium confidence
MRCRv222.8%estimated ± 11.3 pp, low confidence
MMLongBench-Doc35.6%estimated ± 2.6 pp, low confidence
BioBasicsBench33.9%estimated ± 10.7 pp, low confidence
PinchBench68.2%measured