benchgap
Other · model

LFM2.5-8B-A1B benchmark scores

As of 2026-11-22, LFM2.5-8B-A1B (Other) has measured scores on 13 benchmarks and estimated scores on 38 more.

BenchmarkScoreSource
AA-GPQA Diamond51.3%measured
AA-HLE6.9%measured
AIME2650.0%measured
Artificial Analysis Intelligence Index12.6%estimated ± 7.2 pp, medium confidence
CritPt0.0%measured
GDPval-AA0.0%estimated ± 5.5 pp, low confidence
GPQA Diamond71.0%estimated ± 2.4 pp, high confidence
HLE17.4%estimated ± 8.5 pp, medium confidence
IFBench56.5%measured
AA-LCR0.0%measured
AA-Omniscience Accuracy9.4%measured
BrowseComp70.2%estimated ± 13.0 pp, low confidence
HLE w/ tools42.5%estimated ± 5.5 pp, medium confidence
IFEval91.8%measured
LongBench v251.2%estimated ± 5.5 pp, low confidence
τ²-bench results88.1%measured
APEX-Agents-AA25.4%estimated ± 11.4 pp, low confidence
BioMysteryBench (human-difficult)0.0%estimated ± 6.8 pp, low confidence
BFCL v449.7%measured
AA Agentic Index22.3%estimated ± 12.7 pp, low confidence
MMLU-Pro69.5%estimated ± 5.0 pp, medium confidence
AA-IFBench55.6%measured
AIME 202458.2%estimated ± 2.6 pp, high confidence
GPQA55.5%estimated ± 6.1 pp, medium confidence
MMLU80.3%estimated ± 0.9 pp, medium confidence
Vals GPQA Diamond50.4%estimated ± 3.2 pp, high confidence
Vals MMLU-Pro51.6%estimated ± 2.9 pp, medium confidence
MATH-50088.8%measured
MMMLU83.3%estimated ± 0.7 pp, medium confidence
AIME 202542.5%measured
AA MMLU-Pro82.4%estimated ± 0.8 pp, medium confidence
ARC-AGI-174.7%estimated ± 7.8 pp, low confidence
ARC-AGI-230.5%estimated ± 14.4 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)0.3%estimated ± 2.5 pp, low confidence
HLE w/o tools5.4%estimated ± 5.4 pp, low confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
C-Eval90.8%estimated ± 1.1 pp, low confidence
HMMT Feb 202627.1%estimated ± 4.0 pp, high confidence
MCP Atlas35.9%estimated ± 14.2 pp, low confidence
MMLU-Redux92.2%estimated ± 0.8 pp, low confidence
SuperGPQA64.4%estimated ± 9.3 pp, low confidence
HealthBench Hard0.0%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)77.1%estimated ± 4.0 pp, low confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
STEMBench2.2%estimated ± 0.2 pp, low confidence
SimpleQA3.5%estimated ± 4.3 pp, low confidence
IMOAnswerBench47.3%estimated ± 10.7 pp, low confidence
MRCRv222.8%estimated ± 11.3 pp, low confidence
BioBasicsBench33.9%estimated ± 10.7 pp, low confidence
PinchBench59.0%estimated ± 5.0 pp, low confidence