benchgap
Other · model

LFM2.5-VL-450M benchmark scores

As of 2026-11-22, LFM2.5-VL-450M (Other) has measured scores on 7 benchmarks and estimated scores on 34 more.

BenchmarkScoreSource
AA-GPQA Diamond23.3%estimated ± 6.2 pp, medium confidence
AA-HLE0.0%estimated ± 5.7 pp, medium confidence
Artificial Analysis Intelligence Index9.4%estimated ± 7.4 pp, low confidence
CritPt0.3%estimated ± 4.0 pp, high confidence
GPQA Diamond26.3%estimated ± 1.2 pp, high confidence
IFBench12.6%estimated ± 9.2 pp, low confidence
AA-Omniscience Accuracy19.0%estimated ± 8.5 pp, low confidence
IFEval61.2%measured
τ²-bench results39.8%estimated ± 12.4 pp, low confidence
AA-MMMU-Pro47.7%estimated ± 3.0 pp, medium confidence
BFCL v421.1%measured
MMLU-Pro19.3%measured
AA-IFBench10.7%estimated ± 8.8 pp, medium confidence
BBH42.0%estimated ± 2.8 pp, high confidence
GPQA25.7%measured
MMLU44.2%estimated ± 2.1 pp, high confidence
Vals GPQA Diamond24.0%estimated ± 4.5 pp, medium confidence
Vals MMLU-Pro46.9%estimated ± 2.3 pp, medium confidence
MMMLU51.1%estimated ± 1.7 pp, medium confidence
MMMU32.7%measured
AI2D_TEST87.6%estimated ± 1.4 pp, low confidence
C-Eval65.1%estimated ± 1.2 pp, medium confidence
CountBench73.3%measured
DynaMath73.4%estimated ± 5.8 pp, low confidence
ERQA47.1%estimated ± 5.2 pp, low confidence
MathVision25.2%estimated ± 3.6 pp, medium confidence
MLVU (M-Avg)39.2%estimated ± 2.4 pp, medium confidence
MMLU-Redux58.0%estimated ± 0.6 pp, medium confidence
MMMU-Pro20.5%estimated ± 2.2 pp, medium confidence
RealWorldQA58.4%measured
ScreenSpot Pro55.3%estimated ± 7.9 pp, low confidence
SimpleVQA21.6%estimated ± 7.1 pp, low confidence
SuperGPQA7.0%estimated ± 12.4 pp, low confidence
Video-MME (w/o subtitle)58.0%estimated ± 1.2 pp, medium confidence
Video-MME (with subtitle)48.0%estimated ± 3.2 pp, medium confidence
VideoMMMU38.7%estimated ± 2.3 pp, medium confidence
We-Math53.7%estimated ± 7.2 pp, low confidence
SimpleQA14.6%estimated ± 13.4 pp, low confidence
MMVU37.8%estimated ± 3.8 pp, low confidence
RefCOCO (avg)81.9%estimated ± 3.1 pp, low confidence
OCRBench V231.9%estimated ± 5.4 pp, low confidence