benchgap
Other · model

Apodex 1.1 benchmark scores

As of 2026-11-21, Apodex 1.1 (Other) has measured scores on 18 benchmarks and estimated scores on 119 more.

BenchmarkScoreSource
AA-GPQA Diamond86.4%measured
AA-HLE34.1%measured
AA-SciCode45.5%measured
Artificial Analysis Intelligence Index13.7%measured
CritPt4.6%measured
GDPval-AA34.4%measured
GPQA Diamond92.7%estimated ± 2.3 pp, high confidence
HLE56.1%measured
AA-LCR79.3%measured
LiveCodeBench v686.9%estimated ± 4.7 pp, high confidence
AA-Omniscience Accuracy28.2%measured
SciCode45.5%estimated ± 3.1 pp, high confidence
Terminal-Bench 2.170.8%measured
BrowseComp84.0%estimated ± 4.2 pp, high confidence
HLE w/ tools56.1%measured
LongBench v265.1%estimated ± 5.5 pp, medium confidence
τ²-bench results98.0%estimated ± 3.1 pp, high confidence
AA Coding Index60.8%measured
AA-MMMU-Pro79.2%measured
APEX-Agents38.5%measured
APEX-Agents-AA31.2%measured
BioMysteryBench (human-difficult)35.3%measured
DeepSearchQA92.4%measured
SWE-bench Verified77.7%measured
AutomationBench37.1%estimated ± 7.4 pp, low confidence
BFCL v475.1%estimated ± 2.7 pp, medium confidence
CyberGym65.6%estimated ± 6.0 pp, medium confidence
JobBench38.7%estimated ± 8.2 pp, low confidence
SWE-bench Pro55.9%estimated ± 4.5 pp, high confidence
WideResearch80.9%estimated ± 4.8 pp, medium confidence
AA Agentic Index27.8%estimated ± 3.1 pp, high confidence
MMLU-Pro85.3%estimated ± 5.0 pp, medium confidence
GPQA92.2%estimated ± 1.9 pp, high confidence
MMLU90.5%estimated ± 0.9 pp, high confidence
Vals GPQA Diamond85.5%estimated ± 3.2 pp, high confidence
Vals LiveCodeBench80.6%estimated ± 5.7 pp, low confidence
Vals MMLU-Pro88.8%estimated ± 2.4 pp, medium confidence
MMMLU88.3%estimated ± 0.7 pp, medium confidence
MMMU86.0%estimated ± 2.7 pp, high confidence
AA MMLU-Pro85.3%estimated ± 0.8 pp, high confidence
Gert Labs57.9%estimated ± 8.5 pp, medium confidence
AA EnterpriseOps-Gym45.8%estimated ± 2.3 pp, medium confidence
AA Harvey LAB v1.089.8%estimated ± 1.7 pp, medium confidence
AA Tau3 Banking39.2%estimated ± 2.7 pp, medium confidence
AA Terminal-Bench 2.181.7%estimated ± 2.6 pp, medium confidence
ApprenticeBench7.0%estimated ± 5.0 pp, low confidence
ARC-AGI-178.2%estimated ± 7.8 pp, low confidence
ARC-AGI-239.4%estimated ± 14.4 pp, low confidence
CursorBench 3.132.9%estimated ± 3.4 pp, low confidence
CursorBench 3.246.0%estimated ± 4.4 pp, high confidence
Terminal-Bench 3.08.4%estimated ± 9.1 pp, low confidence
FrontierCode 1.1 Main23.4%estimated ± 4.2 pp, low confidence
FrontierSWE v211.2%estimated ± 14.2 pp, low confidence
MazeBench0.4%estimated ± 5.5 pp, low confidence
OfficeQA Pro51.9%estimated ± 6.8 pp, medium confidence
OSWorld-Verified78.9%estimated ± 7.1 pp, low confidence
ParseBench-164.3%estimated ± 6.2 pp, medium confidence
Terminal-Bench 4.18.2%estimated ± 10.9 pp, low confidence
Vals SWE-bench78.7%estimated ± 5.5 pp, medium confidence
Terminal-Bench 2.1 (Vals AI)60.6%estimated ± 7.3 pp, medium confidence
CWE-Bench-AA56.9%estimated ± 5.2 pp, medium confidence
AA Cyber Index37.1%estimated ± 12.8 pp, low confidence
DeepsecBench-AA7.0%estimated ± 8.9 pp, low confidence
HealthBench Professional (length-adjusted, Artificial Analysis)50.0%estimated ± 4.3 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)40.2%estimated ± 0.8 pp, low confidence
AA ITBench41.9%estimated ± 5.1 pp, low confidence
Bug Hunt Bench9.1%estimated ± 9.0 pp, low confidence
Chartography (tools)82.9%estimated ± 4.1 pp, low confidence
CursorBench 4.031.8%estimated ± 4.9 pp, medium confidence
CWE-bench v143.5%estimated ± 6.4 pp, medium confidence
DeepSWE34.7%estimated ± 6.4 pp, low confidence
DRACO78.4%estimated ± 2.0 pp, medium confidence
FrontierCode 2.026.1%estimated ± 9.3 pp, low confidence
HLE w/o tools26.8%estimated ± 4.9 pp, high confidence
OSWorld 2.150.5%estimated ± 6.0 pp, low confidence
OSWorld 2.1 Offline14.3%estimated ± 1.9 pp, low confidence
PostTrainBench v1.115.9%estimated ± 5.7 pp, low confidence
Toolathlon-Verified60.5%estimated ± 3.1 pp, high confidence
VulcanBench Frontier v475.7%estimated ± 6.8 pp, low confidence
AA AutomationBench41.9%estimated ± 7.9 pp, low confidence
GDP.pdf17.0%estimated ± 4.6 pp, high confidence
AA Terminal-Bench 4.04.3%estimated ± 11.0 pp, low confidence
ARC-AGI-37.5%estimated ± 8.3 pp, medium confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
cursorBench4144.8%estimated ± 3.7 pp, medium confidence
MKA28.1%estimated ± 6.4 pp, low confidence
Vibe Code Bench17.6%estimated ± 8.4 pp, medium confidence
Hermes Bench70.6%estimated ± 1.8 pp, high confidence
Hermes Index30.2%estimated ± 8.7 pp, medium confidence
ParseBench-270.6%estimated ± 6.2 pp, medium confidence
CharXiv83.5%estimated ± 6.3 pp, low confidence
CharXiv w/o tools82.8%estimated ± 2.5 pp, high confidence
ExploitGym5.2%estimated ± 10.6 pp, low confidence
AI2D_TEST94.1%estimated ± 2.0 pp, medium confidence
C-Eval89.7%estimated ± 1.0 pp, medium confidence
CountBench97.7%estimated ± 2.9 pp, medium confidence
DynaMath85.5%estimated ± 3.0 pp, medium confidence
ERQA68.5%estimated ± 3.1 pp, high confidence
MathVision89.8%estimated ± 3.1 pp, high confidence
MCP Atlas84.5%estimated ± 6.6 pp, low confidence
MMLU-Redux94.5%estimated ± 0.8 pp, medium confidence
MMMU-Pro79.9%estimated ± 1.5 pp, high confidence
NL2Repo44.3%estimated ± 4.7 pp, high confidence
PostTrainBench v116.5%estimated ± 5.5 pp, low confidence
QwenClawBench92.2%estimated ± 6.0 pp, low confidence
RealWorldQA85.7%estimated ± 2.9 pp, medium confidence
ScreenSpot Pro77.0%estimated ± 10.8 pp, low confidence
SuperGPQA95.0%estimated ± 7.2 pp, low confidence
Toolathlon55.8%estimated ± 6.3 pp, medium confidence
V*100.0%estimated ± 7.5 pp, medium confidence
Video-MME (w/o subtitle)86.1%estimated ± 1.7 pp, medium confidence
Video-MME (with subtitle)87.8%estimated ± 3.7 pp, medium confidence
AA LiveCodeBench88.1%estimated ± 4.7 pp, low confidence
HealthBench Hard23.0%estimated ± 8.6 pp, low confidence
MedXpertQA (MM)76.6%estimated ± 6.5 pp, low confidence
MMLU-Pro (Arcee)94.4%estimated ± 4.0 pp, low confidence
React Native Evals78.6%estimated ± 2.7 pp, medium confidence
ResearchClawBench17.7%estimated ± 2.2 pp, medium confidence
SWE-Rebench61.0%estimated ± 3.6 pp, medium confidence
PostTrainBench12.0%estimated ± 5.9 pp, low confidence
BioMysteryBench (human-solvable)81.8%estimated ± 0.6 pp, low confidence
HealthBench (raw)43.1%estimated ± 6.0 pp, low confidence
HealthBench (length-adjusted)51.3%estimated ± 3.4 pp, low confidence
HealthBench Professional56.7%estimated ± 4.2 pp, low confidence
HealthBench Professional (raw)54.0%estimated ± 4.5 pp, medium confidence
HLE-Verified0.0%estimated ± 6.8 pp, low confidence
LABBench277.3%estimated ± 2.4 pp, low confidence
ScarfBench26.8%estimated ± 9.1 pp, low confidence
STEMBench2.4%estimated ± 0.2 pp, medium confidence
SimpleQA29.4%estimated ± 4.3 pp, medium confidence
LiveCodeBench77.9%estimated ± 14.6 pp, low confidence
BabyVision w/ Python90.3%estimated ± 4.0 pp, low confidence
OpenHarmony Bench v1.051.0%estimated ± 2.4 pp, high confidence
MRCRv285.7%estimated ± 11.3 pp, low confidence
MMLongBench-Doc61.4%estimated ± 2.6 pp, low confidence
BioBasicsBench33.9%estimated ± 2.8 pp, low confidence
MMMU-Pro w/ Python82.0%estimated ± 2.0 pp, high confidence