benchgap
Other · model

Sakana Fugu-Ultra benchmark scores

As of 2026-11-22, Sakana Fugu-Ultra (Other) has measured scores on 10 benchmarks and estimated scores on 71 more.

BenchmarkScoreSource
AA-GPQA Diamond92.2%estimated ± 2.7 pp, high confidence
AA-HLE53.7%estimated ± 3.9 pp, high confidence
AA-SciCode57.4%estimated ± 3.0 pp, high confidence
Artificial Analysis Intelligence Index41.2%estimated ± 5.6 pp, medium confidence
CritPt30.3%estimated ± 4.0 pp, high confidence
GPQA Diamond95.5%measured
HLE57.2%estimated ± 6.5 pp, medium confidence
AA-LCR74.3%estimated ± 3.4 pp, medium confidence
LiveCodeBench v693.2%measured
AA-Omniscience Accuracy49.8%estimated ± 7.7 pp, medium confidence
SciCode58.7%measured
Terminal-Bench 2.182.1%measured
AA Coding Index67.8%estimated ± 5.7 pp, low confidence
AA-MMMU-Pro79.1%estimated ± 4.9 pp, medium confidence
SWE-bench Verified91.8%estimated ± 3.6 pp, high confidence
SWE-bench Pro73.7%measured
MMLU-Pro85.8%estimated ± 2.5 pp, low confidence
GPQA95.5%measured
MMLU88.1%estimated ± 4.2 pp, medium confidence
Vals GPQA Diamond94.3%estimated ± 2.1 pp, medium confidence
Vals LiveCodeBench88.4%estimated ± 0.8 pp, low confidence
Vals MMLU-Pro89.6%estimated ± 0.9 pp, medium confidence
MMMLU91.4%estimated ± 1.1 pp, low confidence
MMMU88.1%estimated ± 3.7 pp, low confidence
AA MMLU-Pro87.4%estimated ± 1.2 pp, low confidence
AA Terminal-Bench 2.181.7%estimated ± 2.6 pp, high confidence
ARC-AGI-196.7%estimated ± 2.5 pp, high confidence
ARC-AGI-287.1%estimated ± 9.7 pp, medium confidence
CursorBench 3.163.2%estimated ± 5.6 pp, low confidence
CursorBench 3.269.1%estimated ± 3.6 pp, high confidence
Terminal-Bench 3.015.2%estimated ± 9.1 pp, low confidence
FrontierCode 1.1 Main46.7%estimated ± 5.0 pp, high confidence
FrontierSWE v239.3%estimated ± 8.3 pp, medium confidence
ParseBench-164.0%estimated ± 8.6 pp, low confidence
Terminal-Bench 4.119.1%estimated ± 10.9 pp, low confidence
Vals SWE-bench77.7%estimated ± 5.3 pp, low confidence
Terminal-Bench 2.1 (Vals AI)69.2%estimated ± 7.3 pp, medium confidence
HealthBench Professional (length-adjusted, Artificial Analysis)58.5%estimated ± 4.4 pp, medium confidence
HealthBench Professional (raw, Artificial Analysis)67.1%estimated ± 2.6 pp, medium confidence
Bug Hunt Bench37.1%estimated ± 12.1 pp, low confidence
CursorBench 4.045.9%estimated ± 3.3 pp, high confidence
DeepSWE63.8%estimated ± 8.4 pp, low confidence
FrontierCode 2.028.4%estimated ± 6.7 pp, medium confidence
HLE w/o tools50.0%measured
PostTrainBench v1.134.9%estimated ± 4.4 pp, high confidence
VulcanBench Frontier v486.5%estimated ± 8.3 pp, low confidence
AA Terminal-Bench 4.04.3%estimated ± 11.0 pp, low confidence
ARC-AGI-311.4%estimated ± 7.2 pp, medium confidence
CharXiv86.6%measured
CharXiv w/o tools79.9%estimated ± 2.4 pp, high confidence
AI2D_TEST93.5%estimated ± 0.9 pp, low confidence
C-Eval93.7%estimated ± 1.2 pp, medium confidence
CountBench97.5%estimated ± 3.7 pp, low confidence
DynaMath87.4%estimated ± 0.8 pp, low confidence
ERQA69.4%estimated ± 5.6 pp, medium confidence
MathVision89.3%estimated ± 3.3 pp, high confidence
MLVU (M-Avg)87.8%estimated ± 1.5 pp, high confidence
MMLU-Redux95.6%estimated ± 1.7 pp, medium confidence
MMMU-Pro80.2%estimated ± 3.1 pp, high confidence
NL2Repo62.1%estimated ± 2.8 pp, medium confidence
PostTrainBench v139.5%estimated ± 4.6 pp, medium confidence
RealWorldQA86.0%estimated ± 1.5 pp, high confidence
ScreenSpot Pro81.2%estimated ± 6.8 pp, medium confidence
SuperGPQA82.8%estimated ± 8.5 pp, low confidence
Video-MME (with subtitle)89.4%estimated ± 2.9 pp, high confidence
VideoMMMU86.5%estimated ± 1.5 pp, medium confidence
We-Math84.6%estimated ± 7.9 pp, low confidence
HealthBench Hard36.6%estimated ± 5.1 pp, low confidence
LiveCodeBench Pro90.8%measured
MedXpertQA (MM)77.7%estimated ± 6.4 pp, low confidence
MedXpertQA (Text)75.1%estimated ± 4.5 pp, low confidence
MMLU-Pro (Arcee)88.7%estimated ± 3.4 pp, low confidence
PostTrainBench32.2%estimated ± 3.7 pp, high confidence
FrontierCode 1.1 Extended59.9%estimated ± 3.0 pp, medium confidence
HealthBench Professional57.9%estimated ± 4.2 pp, medium confidence
SimpleQA38.6%estimated ± 13.4 pp, low confidence
OpenHarmony Bench v1.060.9%estimated ± 4.9 pp, low confidence
BabyVision67.8%estimated ± 11.5 pp, low confidence
MMVU79.2%estimated ± 3.6 pp, medium confidence
MRCRv293.6%measured
BioBasicsBench57.4%estimated ± 2.2 pp, medium confidence