benchgap
Other · model

Hy3 Preview benchmark scores

As of 2026-11-21, Hy3 Preview (Other) has measured scores on 19 benchmarks and estimated scores on 100 more.

BenchmarkScoreSource
AA-GPQA Diamond89.7%measured
AA-HLE33.5%measured
AA-SciCode48.6%measured
Artificial Analysis Intelligence Index41.2%measured
CritPt4.9%measured
GDPval-AA35.8%measured
GPQA Diamond87.2%measured
HLE25.5%measured
IFBench63.1%measured
AA-LCR66.7%measured
LiveCodeBench v680.8%estimated ± 4.4 pp, high confidence
AA-Omniscience Accuracy31.5%measured
SciCode41.2%measured
BrowseComp59.4%estimated ± 6.6 pp, medium confidence
HLE w/ tools51.1%estimated ± 5.3 pp, medium confidence
IFEval90.1%estimated ± 3.6 pp, high confidence
LongBench v256.8%estimated ± 5.5 pp, medium confidence
AA Coding Index58.8%measured
APEX-Agents27.8%estimated ± 9.4 pp, low confidence
APEX-Agents-AA28.2%estimated ± 9.5 pp, medium confidence
BioMysteryBench (human-difficult)37.0%estimated ± 6.8 pp, low confidence
DeepSearchQA87.4%estimated ± 4.5 pp, high confidence
SWE-bench Verified74.4%measured
BFCL v475.2%estimated ± 2.7 pp, medium confidence
CyberGym65.3%estimated ± 5.3 pp, medium confidence
JobBench35.6%estimated ± 8.7 pp, medium confidence
SWE-bench Pro52.3%estimated ± 4.5 pp, high confidence
WideResearch49.7%estimated ± 5.9 pp, low confidence
AA Agentic Index25.6%measured
MMLU-Pro84.5%estimated ± 4.4 pp, high confidence
AA-IFBench56.7%estimated ± 7.4 pp, medium confidence
FailureSensorIQ62.7%estimated ± 1.7 pp, high confidence
GPQA87.2%measured
MMLU90.5%estimated ± 0.9 pp, high confidence
Vals GPQA Diamond86.5%estimated ± 2.1 pp, high confidence
Vals LiveCodeBench84.2%estimated ± 0.8 pp, low confidence
Vals MMLU-Pro85.1%estimated ± 1.6 pp, high confidence
MMMLU88.4%estimated ± 0.7 pp, medium confidence
Chess Puzzles19.3%estimated ± 12.3 pp, low confidence
AA MMLU-Pro85.9%estimated ± 0.8 pp, high confidence
Gert Labs36.9%measured
AA Harvey LAB v1.084.3%estimated ± 1.2 pp, medium confidence
AA Tau3 Banking30.7%estimated ± 3.7 pp, high confidence
ARC-AGI-184.8%estimated ± 2.5 pp, medium confidence
ARC-AGI-241.7%estimated ± 9.7 pp, low confidence
CursorBench 3.140.6%estimated ± 3.4 pp, low confidence
CursorBench 3.243.9%estimated ± 4.4 pp, medium confidence
FrontierCode 1.1 Main17.6%estimated ± 4.2 pp, low confidence
FrontierSWE v215.9%estimated ± 14.2 pp, low confidence
MazeBench0.4%estimated ± 5.5 pp, low confidence
Mystery Game Puzzles13.5%estimated ± 14.6 pp, low confidence
NYT Connections17.2%measured
OSWorld-Verified54.8%estimated ± 5.5 pp, medium confidence
Terminal-Bench Hard43.1%estimated ± 4.0 pp, medium confidence
Vals SWE-bench65.9%estimated ± 5.3 pp, low confidence
Terminal-Bench 2.1 (Vals AI)47.8%estimated ± 6.4 pp, medium confidence
CWE-Bench-AA42.6%estimated ± 10.1 pp, low confidence
AA Cyber Index16.8%estimated ± 9.2 pp, low confidence
DeepsecBench-AA8.4%estimated ± 8.9 pp, low confidence
HealthBench Professional (length-adjusted, Artificial Analysis)58.4%estimated ± 4.3 pp, medium confidence
HealthBench Professional (raw, Artificial Analysis)41.4%estimated ± 0.8 pp, low confidence
AA ITBench36.2%estimated ± 2.8 pp, high confidence
Bug Hunt Bench7.5%estimated ± 9.0 pp, low confidence
CursorBench 4.034.9%estimated ± 4.9 pp, medium confidence
CWE-bench v144.7%estimated ± 6.4 pp, medium confidence
DeepSWE30.4%estimated ± 6.4 pp, low confidence
DRACO79.1%estimated ± 2.0 pp, medium confidence
FrontierCode 2.026.1%estimated ± 9.3 pp, low confidence
HLE w/o tools39.2%estimated ± 2.7 pp, medium confidence
OSWorld 2.152.0%estimated ± 6.0 pp, low confidence
OSWorld 2.1 Offline17.5%estimated ± 1.9 pp, low confidence
PostTrainBench v1.114.6%estimated ± 5.7 pp, low confidence
StealthMark41.3%estimated ± 10.7 pp, low confidence
Toolathlon-Verified55.3%estimated ± 2.3 pp, medium confidence
VulcanBench Frontier v478.8%estimated ± 6.8 pp, low confidence
GDP.pdf17.0%estimated ± 4.6 pp, high confidence
ARC-AGI-30.0%estimated ± 8.6 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
cursorBench4144.8%estimated ± 3.7 pp, medium confidence
MKA29.0%estimated ± 6.4 pp, low confidence
SkillsBench official leaderboard (BenchFlow)30.8%estimated ± 6.1 pp, medium confidence
BinaryAudit9.9%estimated ± 12.1 pp, low confidence
OTelBench6.8%estimated ± 6.6 pp, medium confidence
Vibe Code Bench1.5%estimated ± 8.4 pp, medium confidence
Hermes Bench63.6%estimated ± 2.9 pp, high confidence
Hermes Index31.3%estimated ± 8.7 pp, medium confidence
ExploitGym6.3%estimated ± 10.6 pp, low confidence
C-Eval91.9%estimated ± 0.9 pp, medium confidence
Claw-Eval53.6%estimated ± 6.8 pp, low confidence
MCP Atlas78.3%estimated ± 7.8 pp, low confidence
MMLU-Redux94.9%estimated ± 0.8 pp, medium confidence
NL2Repo42.7%estimated ± 4.7 pp, high confidence
PostTrainBench v113.4%estimated ± 5.5 pp, low confidence
QwenClawBench93.1%estimated ± 6.0 pp, low confidence
SuperGPQA66.2%estimated ± 7.2 pp, medium confidence
Terminal-Bench 2.054.4%measured
Toolathlon55.8%estimated ± 6.3 pp, medium confidence
AA LiveCodeBench88.1%estimated ± 4.7 pp, low confidence
HealthBench Hard0.0%estimated ± 5.1 pp, low confidence
MedXpertQA (Text)46.4%estimated ± 4.5 pp, low confidence
MMLU-Pro (Arcee)85.9%estimated ± 3.4 pp, medium confidence
React Native Evals77.1%estimated ± 2.7 pp, medium confidence
ResearchClawBench17.9%estimated ± 1.9 pp, high confidence
SWE-Rebench57.1%estimated ± 3.6 pp, medium confidence
BioMysteryBench (human-solvable)81.8%estimated ± 0.6 pp, low confidence
HealthBench (raw)42.5%estimated ± 6.0 pp, low confidence
HealthBench (length-adjusted)51.1%estimated ± 3.4 pp, low confidence
HealthBench Professional58.1%estimated ± 4.2 pp, medium confidence
HealthBench Professional (raw)53.5%estimated ± 4.5 pp, medium confidence
HLE-Verified16.8%estimated ± 2.0 pp, low confidence
LABBench276.6%estimated ± 1.8 pp, low confidence
ScarfBench25.9%estimated ± 9.1 pp, low confidence
STEMBench2.4%estimated ± 0.2 pp, medium confidence
SimpleQA33.9%estimated ± 4.3 pp, low confidence
LiveCodeBench75.8%estimated ± 14.6 pp, low confidence
OpenHarmony Bench v1.051.3%estimated ± 2.4 pp, high confidence
MRCRv256.1%estimated ± 11.3 pp, low confidence
MMLongBench-Doc60.7%estimated ± 2.6 pp, low confidence
BioBasicsBench33.9%estimated ± 2.8 pp, low confidence