benchgap
Other · model

LFM2.5-VL-450M benchmark scores

As of 2026-10-07, LFM2.5-VL-450M (Other) has measured scores on 6 benchmarks and estimated scores on 31 more.

BenchmarkScoreSource
AA-GPQA Diamond23.7%estimated ± 5.4 pp, low confidence
AA-HLE0.0%estimated ± 6.5 pp, low confidence
Artificial Analysis Intelligence Index10.3%estimated ± 6.2 pp, low confidence
CritPt0.6%estimated ± 4.1 pp, medium confidence
GDPval-AA0.0%estimated ± 5.8 pp, low confidence
GPQA Diamond25.7%estimated ± 0.4 pp, high confidence
HLE1.9%estimated ± 8.2 pp, low confidence
IFBench12.0%estimated ± 9.7 pp, low confidence
AA-Omniscience Accuracy16.2%estimated ± 8.1 pp, low confidence
IFEval61.2%measured
τ²-bench results39.6%estimated ± 14.1 pp, low confidence
AA-MMMU-Pro13.4%estimated ± 1.2 pp, medium confidence
BFCL v421.1%measured
MMLU-Pro19.3%measured
GPQA25.7%measured
AA-IFBench0.8%estimated ± 8.2 pp, low confidence
ARC-AGI-10.0%estimated ± 6.9 pp, low confidence
ARC-AGI-20.0%estimated ± 11.6 pp, low confidence
Vals GPQA Diamond9.6%estimated ± 4.8 pp, medium confidence
Vals MMLU-Pro0.0%estimated ± 1.2 pp, medium confidence
HLE w/o tools6.0%estimated ± 4.9 pp, medium confidence
CharXiv0.0%estimated ± 4.1 pp, low confidence
C-Eval39.8%estimated ± 0.9 pp, low confidence
Claw-Eval3.5%estimated ± 2.3 pp, low confidence
MMLU-Redux44.0%estimated ± 0.7 pp, medium confidence
MMMU-Pro16.0%estimated ± 2.4 pp, low confidence
SuperGPQA29.3%estimated ± 9.2 pp, low confidence
V*51.8%estimated ± 1.4 pp, low confidence
ERQA13.7%estimated ± 3.2 pp, low confidence
HealthBench Hard0.0%estimated ± 5.1 pp, low confidence
ARC-AGI-30.0%estimated ± 2.1 pp, medium confidence
HealthBench Professional0.0%estimated ± 4.8 pp, low confidence
MMMU32.7%measured
SimpleVQA13.3%estimated ± 9.5 pp, low confidence
MMLU10.8%estimated ± 3.6 pp, low confidence
RefCOCO (avg)80.3%estimated ± 1.8 pp, low confidence
RealWorldQA58.4%measured