benchgap
Calibration

Which benchmarks predict which

For each ordered pair of same-capability benchmarks with at least 5 shared models, several monotone curves are fitted and the one with the lowest leave-one-out error is kept, if it passes the quality gate (R² ≥ 0.3, error ≤ 15 pp).

CalibrationCurveModelsErrorEstimates
BenchCAD Vision2Code (no tools) → BenchCAD Vision2Code (tools)offset logistic50.0 pp0
Chartography (tools) → BenchCAD Vision2Code (tools)inverse Michaelis–Menten50.0 pp4
BenchCAD Vision2Code (tools) → BenchCAD Vision2Code (no tools)linear50.1 pp1
Chartography (tools) → BenchCAD Vision2Code (no tools)Hill50.1 pp4
GMMLU → MILUHill50.2 pp0
OfficeQA Pro → OfficeQAoffset logistic50.2 pp6
AA-Omniscience Accuracy → STEMBenchlinear80.2 pp162
BioBasicsBench → GPQAMichaelis–Menten50.3 pp2
MILU → GMMLUlinear50.3 pp0
OfficeQA → OfficeQA Prolinear50.3 pp0
HealthBench Hard → HealthBench (length-adjusted)Hill50.4 pp5
HealthBench (raw) → HealthBench HardHill50.4 pp0
MathVision → MathVision w/ PythonMichaelis–Menten + offset50.5 pp12
MAXIFE → NOVA-63linear50.5 pp0
MMMLU → MMLU-Reduxoffset logistic70.5 pp7
MMLU-Pro (Arcee) → CritPtoffset logistic60.6 pp0
CritPt → BioMysteryBench (human-solvable)Hill50.6 pp202
HealthBench (length-adjusted) → HealthBench HardHill50.6 pp2
MMLU-Pro → MMLU-ReduxHill100.6 pp61
MCP Atlas → MCP-TasksHill50.6 pp14
RefCOCO (avg) → CC-OCRlinear50.7 pp5
GraphWalks BFS 256K–1M → ARC-AGI-1offset logistic50.7 pp0
MathVision w/ Python → MathVisionoffset logistic50.7 pp1
HealthBench Hard → HealthBench (raw)Hill50.7 pp5
CritPt → MMMLUHill60.7 pp183
MMAnswerBench → AIME26linear100.7 pp0
MazeBench → DRACOoffset logistic50.7 pp50
FrontierCode 1.1 Extended → VulcanBench v3offset logistic50.7 pp3
AA-Omniscience Accuracy → AA MMLU-Prolinear110.8 pp110
CritPt → HealthBench Professional (raw, Artificial Analysis)Michaelis–Menten60.8 pp94
C-Eval → CritPtlinear60.8 pp4
SciCode → Vals LiveCodeBenchlinear70.8 pp0
AA-Omniscience Accuracy → MMLU-Reduxlinear50.8 pp132
CharXiv → DynaMathHill60.8 pp43
LABBench2 → ARC-AGI-1Michaelis–Menten60.8 pp1
CWE-bench → Toolathlon-Verifiedoffset logistic50.8 pp15
MMMU-Pro w/ Python → MMMU-ProHill100.8 pp0
ARC-AGI-3 → HealthBench (length-adjusted)Hill50.9 pp17
MedXpertQA (Text) → GPQA Diamondoffset logistic50.9 pp1
SuperGPQA → MMLU-ReduxMichaelis–Menten90.9 pp2
SWE Multilingual → MILUHill50.9 pp4
ARC-AGI-3 → GPQAlinear120.9 pp10
BabyVision → MathVisionMichaelis–Menten90.9 pp3
HLE → C-EvalMichaelis–Menten60.9 pp29
CharXiv → AI2D_TESToffset logistic70.9 pp42
AA-Omniscience Accuracy → MMLUoffset logistic100.9 pp146
CharXiv w/o tools → ParseBench-1offset logistic61.0 pp12
Artificial Analysis Intelligence Index → C-Evallinear51.0 pp132
PolyMath → MMLU-ProXHill51.0 pp1
MMMLU → C-EvalHill51.0 pp2
HMMT Feb 2025 → AIME26Michaelis–Menten71.0 pp4
SuperGPQA → C-EvalHill61.0 pp4
CharXiv → MathVision w/ PythonMichaelis–Menten + offset61.0 pp9
MathVision → AI2D_TESTlinear51.0 pp2
OSWorld 2.0 → Toolathlon-VerifiedMichaelis–Menten51.0 pp16
Video-MME (w/o subtitle) → DynaMathoffset logistic61.0 pp1
BenchCAD Vision2Code (no tools) → Chartography (tools)Michaelis–Menten51.1 pp0
MedXpertQA (MM) → MMMU-Prolinear81.1 pp0
ExploitBench Internal Port → DAYJOB Healthcareoffset logistic51.1 pp4
Artificial Analysis Intelligence Index → HealthBench Professional (raw, Artificial Analysis)Michaelis–Menten61.1 pp66
BioBasicsBench → AA-GPQA DiamondMichaelis–Menten51.1 pp2
CritPt → C-Evallinear61.1 pp36
HLE-Verified → ARC-AGI-1offset logistic51.1 pp0
MathVision w/ Python → CharXivMichaelis–Menten + offset61.1 pp0
Vals MMLU-Pro → AA MMLU-ProMichaelis–Menten + offset101.1 pp13
C-Eval → MMLU-ReduxHill101.1 pp0
GPQA Diamond → MMMLUHill51.1 pp30
ExploitBench → DAYJOBinverse Michaelis–Menten51.1 pp13
C-Eval → MMMLUlinear51.2 pp0
LABBench2 → HLE-Verifiedoffset logistic61.2 pp1
Artificial Analysis Intelligence Index → AA MMLU-ProMichaelis–Menten + offset121.2 pp16
GPQA → AA MMLU-Prolinear51.2 pp46
AA Agentic Index → AA Harvey LAB v1.0Hill71.2 pp62
CursorBench 4.0 → AA Coding Indexlinear91.2 pp12
GPQA → C-EvalMichaelis–Menten111.2 pp46
BioMysteryBench (human-difficult) → BioMysteryBench (human-solvable)offset logistic51.2 pp0
Vals MMLU-Pro → MMLUHill81.2 pp22
ProgramBench → VulcanBench Frontier v4offset logistic61.2 pp15
JobBench → WideResearchlinear51.2 pp32
MMMU-Pro → CharXiv w/o toolsoffset logistic91.2 pp50
HealthBench Professional → Vals GPQA Diamondoffset logistic61.2 pp15
HMMT Feb 2025 → HMMT Feb 2026Michaelis–Menten + offset71.2 pp4
MMMU → Video-MME (w/o subtitle)Hill91.2 pp23
JobBench → AA EnterpriseOps-GymMichaelis–Menten51.2 pp32
AA-GPQA Diamond → C-EvalHill71.2 pp9
DRACO → Toolathlon-Verifiedoffset logistic71.2 pp2
GPQA Diamond → GPQAlinear561.2 pp17
GPQA → GPQA Diamondlinear561.2 pp76
HealthBench Professional (raw) → HealthBench Hardinverse Michaelis–Menten51.2 pp2
HealthBench (raw) → HealthBench Professional (raw)Michaelis–Menten81.2 pp0
Artificial Analysis Intelligence Index → MMLU-ReduxMichaelis–Menten61.2 pp17
PostTrainBench v1 → PostTrainBenchlinear61.2 pp7
MMLU-Redux → MMLU-Proinverse Michaelis–Menten101.2 pp0
LABBench2 → AA-GPQA DiamondMichaelis–Menten61.2 pp1
FrontierMath v2 (Tier 4) → AIME26offset logistic51.2 pp30
HealthBench Professional → GPQAoffset logistic71.2 pp9
HealthBench Professional → GPQA Diamondoffset logistic71.2 pp13
MMLU-ProX → NOVA-63Michaelis–Menten71.3 pp5
MathVision → CountBenchoffset logistic61.3 pp19
Mystery Game Puzzles → Cookie-BenchHill51.3 pp71
AIME26 → MMAnswerBenchinverse Michaelis–Menten101.3 pp18
PostTrainBench → PostTrainBench v1linear61.3 pp17
CharXiv w/o tools → MathVision w/ PythonMichaelis–Menten51.3 pp1
PolyMath → NOVA-63Michaelis–Menten51.3 pp1
SWE Multilingual → GMMLUHill51.3 pp4
Video-MME (with subtitle) → AI2D_TESTMichaelis–Menten + offset61.3 pp2
OSWorld 2.0 → AA Harvey LAB v1.0linear51.3 pp7
PostTrainBench v1 → PostTrainBench v1.1Hill61.3 pp7
HMMT Feb 2026 → AIME26Hill221.3 pp3
AIME 2024 → MATH-500Michaelis–Menten151.3 pp5
MMLU-Pro → C-EvalHill71.3 pp2
MMMU-Pro → Video-MME (w/o subtitle)Michaelis–Menten81.3 pp40
SkillsBench → WideResearchHill61.3 pp1
DeepPlanning → MCP-TasksHill51.3 pp1
ARC-AGI-2 → HLE-VerifiedHill51.3 pp17
SWE Multilingual → MMLU-ProXHill81.3 pp37
AA-HLE → AA MMLU-Prooffset logistic131.3 pp32
Claw-Eval → ResearchClawBenchMichaelis–Menten121.3 pp0
AA-HLE → BioMysteryBench (human-solvable)Michaelis–Menten51.4 pp1
RealWorldQA → AI2D_TESToffset logistic71.4 pp5
FrontierCode 1.1 Extended → Vals SWE-benchMichaelis–Menten51.4 pp3
Decision Index Full Score → Artificial Analysis Decision Indexoffset logistic111.4 pp0
NOVA-63 → MMLU-ProXMichaelis–Menten + offset71.4 pp0
ScreenSpot Pro → RealWorldQAlinear71.4 pp0
DynaMath → RealWorldQAMichaelis–Menten + offset71.4 pp0
ARC-AGI-3 → Vals GPQA DiamondMichaelis–Menten131.4 pp4
CritPt → AA MMLU-ProMichaelis–Menten121.4 pp3
Chess Puzzles → ExploitBench Internal Portoffset logistic61.4 pp76
DeepPlanning → τ³-bench resultsMichaelis–Menten61.4 pp1
MMLU-Redux → MMMLUoffset logistic71.4 pp4
MCP-Tasks → τ³-bench resultsMichaelis–Menten51.4 pp0
ARC-AGI-1 → GPQA Diamondoffset logistic151.4 pp16
MMLU-ProX → INCLUDEMichaelis–Menten51.4 pp7
MMLU-Redux → C-Evallinear101.4 pp1
CountBench → AI2D_TESTlinear61.4 pp0
FrontierMath v2 (Tiers 1-3) → AIME26Michaelis–Menten91.4 pp31
LABBench2 → Vals MMLU-ProMichaelis–Menten + offset61.4 pp1
ExploitBench → DAYJOB Healthcareoffset logistic51.5 pp9
ARC-AGI-2 → GPQA Diamondlinear191.5 pp2
CC-OCR → OmniDocBench 1.5Michaelis–Menten61.5 pp2
FrontierMath v2 (Tiers 1-3) → HMMT Nov 2025Michaelis–Menten61.5 pp65
FrontierMath v2 (Tier 4) → HMMT Feb 2026linear61.5 pp33
DAYJOB Healthcare → DAYJOBMichaelis–Menten191.5 pp0
MLVU (M-Avg) → OmniDocBench 1.5offset logistic81.5 pp0
MCP-Tasks → MCP Atlasinverse Michaelis–Menten51.5 pp0
AA-HLE → C-EvalMichaelis–Menten71.5 pp5
MathVision → MLVU (M-Avg)linear81.5 pp17
RealWorldQA → DynaMathoffset logistic71.5 pp2
CharXiv → RealWorldQAMichaelis–Menten121.5 pp29
AA-MMMU-Pro → MMMU-Prooffset logistic391.5 pp70
HMMT Feb 2025 → HMMT Nov 2025linear91.5 pp6
MMMU-Pro → AA-MMMU-Prolinear391.5 pp19
ExploitGym → Hermes BenchMichaelis–Menten61.5 pp17
Agents' Last Exam → Hermes BenchHill71.5 pp9
CharXiv → MLVU (M-Avg)linear91.5 pp26
CharXiv → VideoMMMUHill101.5 pp40
GPQA Diamond → Vals MMLU-ProMichaelis–Menten + offset251.6 pp36
HLE-Verified → AA-GPQA Diamondoffset logistic61.6 pp0
CC-OCR → CountBenchlinear51.6 pp2
ARC-AGI-3 → Vals MMLU-ProMichaelis–Menten131.6 pp5
Vals GPQA Diamond → AA MMLU-Prolinear101.6 pp0
ERQA → DynaMathHill61.6 pp1
AA-GPQA Diamond → AA MMLU-ProHill131.6 pp0
BrowseComp → LifeValHill51.6 pp56
MathVision → CharXiv w/o toolsHill91.6 pp2
ERQA → RealWorldQAMichaelis–Menten111.6 pp0
V* → CountBenchlinear61.6 pp1
DynaMath → CharXivHill61.6 pp1
CyberGym → WideResearchHill51.6 pp15
HealthBench Professional (raw) → HealthBench (raw)inverse Michaelis–Menten81.6 pp2
CursorBench 3.2 → FrontierCode 1.1 Maininverse Michaelis–Menten51.6 pp13
CWE-bench → Hermes Benchlinear71.6 pp7
HMMT Nov 2025 → AIME26Michaelis–Menten101.6 pp1
FrontierCode 1.1 Main → CursorBench 3.2Michaelis–Menten51.6 pp9
CursorBench 3.2 → FrontierCode 1.1 Extendedoffset logistic51.6 pp11
ARC-AGI-2 → GPQAlinear211.6 pp11
BenchCAD Vision2Code (tools) → Chartography (tools)Hill51.6 pp1
We-Math → AI2D_TESTMichaelis–Menten51.6 pp0
ApprenticeBench → Toolathlonlinear51.7 pp11
HLE w/ tools → AA Harvey LAB v1.0Michaelis–Menten51.7 pp22
OSWorld 2.1 Offline → GDPval-AAHill61.7 pp5
CursorBench 4.0 → PostTrainBench v1.1offset logistic51.7 pp16
HealthBench Hard → HealthBench Professional (raw)Michaelis–Menten51.7 pp5
HealthBench (length-adjusted) → HealthBench ProfessionalHill81.7 pp0
DynaMath → Video-MME (with subtitle)offset logistic71.7 pp0
DynaMath → AI2D_TESTMichaelis–Menten51.7 pp0
AA-MMMU-Pro → Video-MME (w/o subtitle)Hill61.7 pp65
ARC-AGI-2 → ARC-AGI-1Michaelis–Menten + offset411.7 pp6
ARC-AGI-1 → LABBench2Hill61.7 pp18
HealthBench Hard → GPQAlinear61.7 pp0
GPQA → MMMLUMichaelis–Menten141.7 pp31
PhysicianBench → HealthBench Professional (raw, Artificial Analysis)linear51.7 pp0
CursorBench 3.1 → AA-SciCodelinear51.7 pp2
AA-GPQA Diamond → MMMLUMichaelis–Menten91.7 pp13
MMMU-Pro → MMMUlinear191.7 pp13
GPQA → MMLU-ReduxMichaelis–Menten + offset161.7 pp24
NYT Connections → FailureSensorIQlinear81.7 pp80
HLE w/ tools → Hermes Benchlinear81.8 pp18
RealWorldQA → OmniDocBench 1.5Hill91.8 pp5
HLE-Verified → LABBench2offset logistic61.8 pp0
ARC-AGI-1 → GPQAlinear191.8 pp1
Vals GPQA Diamond → GPQA DiamondMichaelis–Menten251.8 pp19
GDP.pdf → Hermes Benchoffset logistic61.8 pp4
VideoMMMU → Video-MME (w/o subtitle)Michaelis–Menten + offset81.8 pp0
Vals MMLU-Pro → LABBench2Michaelis–Menten + offset61.8 pp50
DAYJOB → DAYJOB Healthcareinverse Michaelis–Menten191.8 pp0
AA MMLU-Pro → Vals MMLU-Proinverse Michaelis–Menten101.8 pp3
INCLUDE → MMLU-ProXMichaelis–Menten + offset51.8 pp0
MKA → Toolathlon-VerifiedHill51.8 pp3
ParseBench-1 → CharXiv w/o toolsMichaelis–Menten61.8 pp16
C-Eval → MMLU-ProHill71.8 pp0
AIME26 → AIME 2025Hill71.8 pp27
CharXiv w/o tools → RealWorldQAHill51.8 pp2
AA-GPQA Diamond → LABBench2inverse Michaelis–Menten61.8 pp16
HMMT Feb 2026 → HMMT Feb 2025Michaelis–Menten + offset71.8 pp6
CC-OCR → RefCOCO (avg)linear51.8 pp2
CursorBench 4.0 → VulcanBench Frontier v4Hill101.8 pp8
HLE w/o tools → Vals MMLU-ProMichaelis–Menten211.8 pp12
MCP Atlas → ResearchClawBenchlinear131.8 pp29
PostTrainBench v1.1 → PostTrainBench v1Hill61.8 pp2
CountBench → OmniDocBench 1.5Michaelis–Menten + offset51.8 pp1
BinaryAudit → FailureSensorIQMichaelis–Menten51.8 pp6
We-Math → CountBenchoffset logistic61.8 pp0
ARC-AGI-3 → GPQA Diamondlinear141.8 pp1
AA Agentic Index → ResearchClawBenchMichaelis–Menten111.9 pp41
FrontierCode 1.1 Main → Vals LiveCodeBenchlinear91.9 pp8
ARC-AGI-2 → Vals MMLU-ProMichaelis–Menten311.9 pp3
PolyMath → INCLUDEoffset logistic51.9 pp1
Artificial Analysis Decision Index v1.0 → HLE-MultiChoice (Decision Index)linear191.9 pp0
Decision Index Knowledge → Artificial Analysis Decision IndexMichaelis–Menten111.9 pp10
We-Math → DynaMathMichaelis–Menten61.9 pp0
Vals GPQA Diamond → LABBench2Michaelis–Menten + offset61.9 pp1
VideoMMMU → MMMUlinear121.9 pp0
OSWorld 2.0 → BrowseCompoffset logistic111.9 pp13
GDPval-AA → OSWorld 2.1 OfflineHill61.9 pp67
Decision Index Language → WildGuardTest (Decision Index)linear111.9 pp0
HMMT Nov 2025 → HMMT Feb 2025linear91.9 pp2
Vision2Web → MathVision w/ PythonHill51.9 pp0
DAYJOB → ExploitBenchHill51.9 pp14
MathVision → Video-MME (with subtitle)linear81.9 pp17
Vals MMLU-Pro → GPQA Diamondlinear251.9 pp5
AIME26 → HMMT Feb 2025Hill71.9 pp11
NL2Repo → LiveCodeBench v6Michaelis–Menten121.9 pp8
Decision Index Full Score → WildGuardTest (Decision Index)linear111.9 pp2
HLE → GPQAHill531.9 pp6
SkillsBench → BrowseCompHill51.9 pp2
OSWorld 2.0 → ResearchClawBenchHill51.9 pp2
ERQA → AA-MMMU-Prolinear111.9 pp2
MathVision w/ Python → CharXiv w/o toolsMichaelis–Menten + offset51.9 pp1
GDPval-AA → DRACOMichaelis–Menten72.0 pp88
Video-MME (with subtitle) → CountBenchoffset logistic72.0 pp2
HMMT Feb 2025 → AIME 2025linear82.0 pp1
HMMT Feb 2025 → MMAnswerBenchMichaelis–Menten + offset72.0 pp4
MMMU → AI2D_TESTHill82.0 pp15
Video-MME (w/o subtitle) → MMMUHill92.0 pp0
AI2D_TEST → CountBenchlinear62.0 pp1
MAXIFE → MMLU-ProXMichaelis–Menten52.0 pp0
MMMU-Pro w/ Python → AA-MMMU-ProHill102.0 pp0
PerceptionBench → BabyVision w/ PythonMichaelis–Menten52.0 pp1
VITA-Bench → QwenClawBenchoffset logistic62.0 pp7
AA AutomationBench → Hermes Benchoffset logistic62.0 pp0
SWE Multilingual → INCLUDElinear72.0 pp44
HLE w/o tools → GPQA Diamondlinear362.0 pp3
Toolathlon → AA Tau3 Bankingoffset logistic62.0 pp11
ApprenticeBench → AA Harvey LAB v1.0offset logistic52.0 pp2
CursorBench 4.0 → CursorBench 3.2Michaelis–Menten82.0 pp10
AA Coding Index → CursorBench 4.0inverse Michaelis–Menten92.0 pp2
MMAnswerBench → HMMT Nov 2025offset logistic92.0 pp0
MathVision → AA-MMMU-ProMichaelis–Menten152.0 pp2
AIME 2025 → MATH-500linear172.0 pp24
When2Call (Decision Index) → HLE-MultiChoice (Decision Index)Hill192.0 pp0
PostTrainBench v1.1 → PostTrainBenchlinear132.0 pp2
We-Math → RealWorldQAlinear62.0 pp0
AA-MMMU-Pro → AI2D_TESToffset logistic62.0 pp72
AA-GPQA Diamond → HLE-Verifiedoffset logistic62.0 pp44
BabyVision → CharXiv w/o toolslinear52.0 pp2
MMMU-Pro → AI2D_TESTMichaelis–Menten62.0 pp4
SimpleVQA → OmniDocBench 1.5linear82.0 pp7
C-Eval → SuperGPQAHill62.0 pp4
AA-MMMU-Pro → MMMU-Pro w/ Pythonlinear102.1 pp0
HealthBench Professional → AA-GPQA Diamondoffset logistic72.1 pp12
OSWorld-Verified → ResearchClawBenchMichaelis–Menten + offset102.1 pp12
GPQA Diamond → Vals GPQA DiamondHill252.1 pp42
Artificial Analysis Decision Index → HLE-MultiChoice (Decision Index)Hill142.1 pp8
SEC-Bench Pro → DAYJOB HealthcareHill82.1 pp1
HLE → MMLU-ReduxMichaelis–Menten + offset92.1 pp7
MathVision → We-Mathoffset logistic62.1 pp19
ExploitBench Internal Port → DAYJOBHill52.1 pp0
ERQA → CharXiv w/o toolsMichaelis–Menten52.1 pp1
ARC-AGI-3 Provider Adapter → HealthBench Professionaloffset logistic72.1 pp6
VideoMMMU → OCRBench V2Hill62.1 pp10
Video-MME (with subtitle) → DynaMathlinear72.1 pp1
FrontierCode 1.1 Extended → CursorBench 3.2Michaelis–Menten + offset52.1 pp0
ERQA → We-MathMichaelis–Menten52.1 pp7
MMLU-Pro → MMLUMichaelis–Menten + offset192.1 pp27
Video-MME (w/o subtitle) → AA-MMMU-ProHill62.1 pp0
OSWorld-Verified → WideResearchoffset logistic52.1 pp17
Chess Puzzles → FailureSensorIQlinear92.1 pp24
Decision Index Tools → WildGuardTest (Decision Index)linear112.1 pp0
AA-HLE → HealthBench Professional (raw, Artificial Analysis)Hill62.1 pp12
Bug Hunt Bench → SWE-Marathonlinear52.1 pp25
Decision Index Knowledge → HLE-MultiChoice (Decision Index)offset logistic112.1 pp82
MMMLU → GPQA DiamondHill52.1 pp0
ERQA → CountBenchlinear62.2 pp6
OTelBench → Mystery Game PuzzlesMichaelis–Menten52.2 pp8
VideoMMMU → MMMU-ProHill162.2 pp0
Decision Index Retrieval → WildGuardTest (Decision Index)offset logistic112.2 pp10
BBH → MMLUlinear62.2 pp0
GDPval-AA → ResearchClawBenchlinear142.2 pp47
MathVision → OmniDocBench 1.5linear82.2 pp13
GraphWalks BFS 256K–1M → ARC-AGI-2offset logistic52.2 pp0
ARC-AGI-1 → Vals MMLU-ProMichaelis–Menten282.2 pp0
HealthBench Professional → HealthBench (length-adjusted)inverse Michaelis–Menten82.2 pp6
LABBench2 → Vals GPQA DiamondMichaelis–Menten + offset62.2 pp0
PostTrainBench → PostTrainBench v1.1linear132.2 pp6
MMMU → MMMU-Proinverse Michaelis–Menten192.2 pp9
Vals LiveCodeBench → LiveCodeBench v6Michaelis–Menten + offset72.2 pp56
When2Call (Decision Index) → Artificial Analysis Decision Index v1.0Hill192.2 pp0
cursorBench41 → AA-SciCodeHill92.2 pp3
MLVU (M-Avg) → DynaMathMichaelis–Menten72.2 pp0
ZeroBench → MathVisionHill62.2 pp2
MMMU-Pro → MLVU (M-Avg)linear102.2 pp26
Artificial Analysis Decision Index → WildGuardTest (Decision Index)Michaelis–Menten142.2 pp5
CyberGym → Toolathlon-VerifiedMichaelis–Menten72.2 pp9
FrontierCode 1.1 Main → SWE-bench Verifiedlinear72.2 pp0
Decision Index Retrieval → HLE-MultiChoice (Decision Index)offset logistic112.2 pp8
Gert Labs → ResearchClawBenchlinear162.2 pp11
NOVA-63 → MAXIFElinear52.2 pp2
GPQA → BioBasicsBenchinverse Michaelis–Menten52.2 pp32
Toolathlon → ResearchClawBenchMichaelis–Menten92.3 pp0
CursorBench 3.2 → VulcanBench Frontier v4Hill52.3 pp6
AI2D_TEST → MLVU (M-Avg)Michaelis–Menten62.3 pp1
MathVision → RealWorldQAoffset logistic112.3 pp1
AA Agentic Index → Toolathlon-VerifiedMichaelis–Menten72.3 pp46
MMMU → VideoMMMUHill122.3 pp15
Decision Index Retrieval → Artificial Analysis Decision Indexlinear112.3 pp0
Video-MME (w/o subtitle) → MMMU-Prolinear82.3 pp0
OfficeQA Pro → AA-MMMU-Prooffset logistic92.3 pp7
OmniDocBench 1.5 → MLVU (M-Avg)Michaelis–Menten + offset82.3 pp0
AA-AnalystAgent → LifeValMichaelis–Menten52.3 pp15
Decision Index Full Score → HLE-MultiChoice (Decision Index)Michaelis–Menten112.3 pp0
ARC-AGI-3 Provider Adapter → HealthBench Professional (raw)linear62.3 pp7
NL2Repo → SWE-bench VerifiedHill192.3 pp17
Decision Index Knowledge → WildGuardTest (Decision Index)offset logistic112.3 pp2
C-Eval → HLElinear62.3 pp4
DeepSearchQA → AA EnterpriseOps-GymMichaelis–Menten52.3 pp12
FrontierCode 2.0 → AA Coding IndexMichaelis–Menten72.3 pp15
GPQA → Vals MMLU-ProMichaelis–Menten402.3 pp70
ARC-AGI-2 → Vals GPQA DiamondMichaelis–Menten + offset312.3 pp5
HLE → GPQA DiamondMichaelis–Menten422.3 pp4
HealthBench Professional (raw) → HealthBench (length-adjusted)linear82.3 pp0
BrowseComp → ResearchClawBenchMichaelis–Menten102.3 pp7
ApprenticeBench → OSWorld-Verifiedlinear72.3 pp0
ExploitBench Internal Port → SpireClimbMichaelis–Menten62.4 pp3
Decision Index Tools → HLE-MultiChoice (Decision Index)linear112.4 pp0
Hermes Index → Toolathlon-Verifiedlinear82.4 pp0
MMLU → Vals MMLU-Prolinear82.4 pp5
AA-HLE → LABBench2linear72.4 pp25
APEX-Agents-AA → ResearchClawBenchlinear92.4 pp3
MMMU-Pro → MedXpertQA (MM)Hill82.4 pp44
Vals SWE-bench → FrontierCode 1.1 ExtendedHill52.4 pp3
CWE-Bench-AA → AA Tau3 Bankingoffset logistic52.4 pp16
Decision Index Language → HLE-MultiChoice (Decision Index)Michaelis–Menten112.4 pp0
MMMU-Pro → VideoMMMUHill162.4 pp20
Decision Index Arts → HLE-MultiChoice (Decision Index)Michaelis–Menten + offset112.4 pp0
ARC-AGI-1 → Vals GPQA DiamondMichaelis–Menten282.4 pp0
MMMU → MLVU (M-Avg)Hill82.4 pp11
FrontierSWE v2 → PostTrainBenchoffset logistic102.4 pp14
MMAnswerBench → HMMT Feb 2025Michaelis–Menten72.4 pp0
SuperGPQA → GPQAHill162.4 pp3
AA-HLE → GPQA Diamondoffset logistic502.4 pp61
AA-SciCode → OpenHarmony Bench v1.0offset logistic112.4 pp92
MMLU → AA-Omniscience Accuracyoffset logistic102.4 pp21
CharXiv w/o tools → CharXivMichaelis–Menten152.4 pp2
Video-MME (with subtitle) → MLVU (M-Avg)Michaelis–Menten102.4 pp0
Video-MME (with subtitle) → AA-MMMU-ProMichaelis–Menten82.4 pp0
When2Call (Decision Index) → Decision Index Artslinear112.4 pp8
FrontierMath v2 (Tiers 1-3) → MMAnswerBenchlinear72.4 pp62
CWE-bench v1 → Hermes Benchlinear52.4 pp4
RealWorldQA → AA-MMMU-ProMichaelis–Menten92.4 pp1
CharXiv → CharXiv w/o toolsoffset logistic152.4 pp5
AI2D_TEST → MMMU-Proinverse Michaelis–Menten62.4 pp0
ARC-AGI-3 → HLElinear82.4 pp0
MMLU → BBHlinear62.4 pp29
HLE → Vals MMLU-Prolinear322.4 pp6
GMMLU → SWE MultilingualHill52.4 pp0
AI2D_TEST → DynaMathMichaelis–Menten52.4 pp1
LVBench → CharXiv w/o toolsMichaelis–Menten62.5 pp1
DeepSWE → AA Coding Indexlinear202.5 pp28
DeepsecBench-AA → Toolathlon-VerifiedMichaelis–Menten82.5 pp1
ERQA → OmniDocBench 1.5linear72.5 pp2
SWE-bench Multimodal → OfficeQA ProHill62.5 pp2
Artificial Analysis Decision Index → Decision Index Full Scoreinverse Michaelis–Menten112.5 pp11
CursorBench 4.0 → AA-SciCodeHill172.5 pp1
Terminal-Bench 2.1 (Vals AI) → AA Terminal-Bench 2.1Hill182.5 pp48
cursorBench41 → VulcanBench Frontier v4Hill62.5 pp1
GPQA Diamond → ARC-AGI-1Hill152.5 pp47
PerceptionBench → CharXiv w/o toolslinear62.5 pp0
BabyVision → MMMU-Prolinear62.5 pp4
PostTrainBench → AA Coding IndexMichaelis–Menten122.5 pp0
Video-MME (w/o subtitle) → AI2D_TESTMichaelis–Menten + offset72.5 pp0
ARC-AGI-3 → LABBench2linear52.5 pp2
BabyVision w/ Python → PerceptionBenchinverse Michaelis–Menten52.5 pp4
Artificial Analysis Decision Index v1.0 → WildGuardTest (Decision Index)linear192.5 pp0
Chess Puzzles → Cookie-Benchlinear52.5 pp19
ARC-AGI-1 → HealthBench (length-adjusted)Michaelis–Menten62.5 pp15
OmniDocBench 1.5 → CountBenchHill52.5 pp0
Decision Index Tools → Artificial Analysis Decision IndexHill112.5 pp0
AA-Omniscience Accuracy → HealthBench Professional (raw, Artificial Analysis)Hill62.5 pp24
HLE w/o tools → MMLU-ProMichaelis–Menten72.5 pp49
AA-MMMU-Pro → CharXiv w/o toolsMichaelis–Menten + offset112.5 pp30
MCP-Tasks → WideResearchlinear52.5 pp0
MMMU-Pro → MMMU-Pro w/ PythonMichaelis–Menten102.6 pp18
cursorBench41 → CursorBench 4.0linear112.6 pp1
SEC-Bench Pro → DAYJOBHill82.6 pp1
MazeBench → Toolathlon-Verifiedlinear102.6 pp5
Artificial Analysis Intelligence Index → GPQA DiamondMichaelis–Menten422.6 pp8
Artificial Analysis Decision Index → Decision Index Retrievallinear112.6 pp11
HealthBench (raw) → HealthBench (length-adjusted)Michaelis–Menten82.6 pp0
MMAnswerBench → HMMT Feb 2026Michaelis–Menten102.6 pp0
Vals SWE-bench → AA LiveCodeBenchHill92.6 pp63
FrontierSWE v2 → CursorBench 4.0linear152.6 pp3
AA-LCR → MMLongBench-DocMichaelis–Menten + offset62.6 pp191
WildGuardTest (Decision Index) → HLE-MultiChoice (Decision Index)linear192.6 pp0
AI2D_TEST → MathVisioninverse Michaelis–Menten52.6 pp3
HLE w/o tools → HealthBench Professional (raw, Artificial Analysis)Michaelis–Menten52.6 pp11
MCP Atlas → QwenClawBenchHill82.6 pp44
Decision Index Full Score → Decision Index Knowledgeinverse Michaelis–Menten1102.6 pp0
AA-HLE → MMMLUlinear92.6 pp10
JobBench → ResearchClawBenchlinear52.6 pp4
Terminal-Bench 2.1 → AA Terminal-Bench 2.1offset logistic142.6 pp40
CursorBench 4.0 → cursorBench41linear112.6 pp2
HLE-MultiChoice (Decision Index) → WildGuardTest (Decision Index)Michaelis–Menten + offset192.6 pp0
Chartography (tools) → OfficeQAoffset logistic52.6 pp2
MedXpertQA (MM) → AA-MMMU-Prolinear62.6 pp0
Decision Index Language → Artificial Analysis Decision IndexHill112.6 pp3
AIME 2025 → AIME 2024Michaelis–Menten172.6 pp32
FrontierCode 1.1 Extended → AA Coding Indexoffset logistic62.6 pp0
When2Call (Decision Index) → WildGuardTest (Decision Index)Hill192.7 pp0
AA-GPQA Diamond → GPQA DiamondHill412.7 pp0
DRACO → BrowseCompHill52.7 pp2
Chartography (no tools) → Chartography (tools)Michaelis–Menten72.7 pp5
SWE-bench Multimodal → OfficeQAoffset logistic52.7 pp1
ExploitBench → FACTS Multimodallinear62.7 pp12
Vals GPQA Diamond → MMLUlinear82.7 pp0
ExploitBench → FrontierPhysicsinverse Michaelis–Menten122.7 pp6
BBH → MMLU-Proinverse Michaelis–Menten82.7 pp0
Protocols (troubleshooting) → SingleCellBenchHill52.7 pp0
SWE-bench Verified → React Native Evalslinear72.7 pp0
CursorBench 3.2 → AA-SciCodelinear172.7 pp0
Furniture Assembly → DAYJOBoffset logistic162.7 pp19
OSWorld 2.1 Offline → AA-AnalystAgentlinear62.7 pp5
APEX-Agents-AA → AA Tau3 Bankingoffset logistic62.7 pp10
ARC-AGI-2 → AA-GPQA Diamondlinear302.7 pp9
MLVU (M-Avg) → AI2D_TESTMichaelis–Menten62.7 pp0
HLE w/o tools → AA-GPQA DiamondMichaelis–Menten + offset252.7 pp23
SimpleQA → AA-Omniscience AccuracyMichaelis–Menten72.7 pp4
Terminal-Bench 3.0 → AA Terminal-Bench 2.1Michaelis–Menten92.7 pp0
We-Math → ERQAinverse Michaelis–Menten52.7 pp1
SWE-bench Pro → LiveCodeBench v6Michaelis–Menten + offset222.7 pp21
GDPval-AA → BFCL v4Michaelis–Menten + offset92.7 pp118
AA MMLU-Pro → CritPtoffset logistic122.7 pp1
ARC-AGI-1 → AA-GPQA Diamondlinear282.7 pp0
GDP.pdf → Hermes Indexoffset logistic62.7 pp17
AA-GPQA Diamond → AA-HLEoffset logistic1902.7 pp3
MMMU-Pro → MMVUMichaelis–Menten72.7 pp52
AA-MMMU-Pro → MMMUMichaelis–Menten152.7 pp65
MILU → SWE MultilingualHill52.7 pp0
ParseBench-1 → MMMU-Pro w/ PythonMichaelis–Menten62.7 pp10
Decision Index Arts → Artificial Analysis Decision Indexlinear112.7 pp2
ZeroBench → PerceptionBenchoffset logistic52.7 pp6
NL2Repo → OpenHarmony Bench v1.0Hill102.7 pp18
PerceptionBench → MathVisionHill52.7 pp1
OTelBench → FailureSensorIQMichaelis–Menten52.8 pp1
HMMT Feb 2026 → MMAnswerBenchMichaelis–Menten + offset102.8 pp2
PostTrainBench v1.1 → VulcanBench Frontier v4Hill52.8 pp4
VideoMMMU → MLVU (M-Avg)linear102.8 pp0
Gert Labs → AA ITBenchHill82.8 pp43
AA-IFBench → IFEvalHill312.8 pp109
CursorBench 3.1 → Vals LiveCodeBenchlinear62.8 pp1
MLVU (M-Avg) → Video-MME (with subtitle)linear102.8 pp0
AA Coding Index → OpenHarmony Bench v1.0linear102.8 pp8
CountBench → AA-MMMU-ProMichaelis–Menten52.8 pp1
PostTrainBench v1 → Vals SWE-benchMichaelis–Menten102.8 pp3
AA-AnalystAgent → Toolathlon-Verifiedlinear62.8 pp3
MLVU (M-Avg) → RealWorldQAMichaelis–Menten + offset102.8 pp0
MMLU-Pro → BBHMichaelis–Menten + offset82.8 pp52
FrontierCode 1.1 Main → Vals SWE-benchHill92.8 pp4
PostTrainBench v1.1 → FrontierCode 1.1 Mainoffset logistic62.8 pp4
RefCOCO (avg) → AI2D_TESToffset logistic62.8 pp0
We-Math → OmniDocBench 1.5offset logistic52.8 pp0
PostTrainBench → VulcanBench Frontier v4Michaelis–Menten52.8 pp3
GPQA Diamond → MMLU-ReduxMichaelis–Menten92.8 pp12
Mystery Game Puzzles → BlenderWorld (text-only)Hill52.8 pp71
SpireClimb → ExploitBench Internal Portinverse Michaelis–Menten62.8 pp0
AA-HLE → BioBasicsBenchoffset logistic72.8 pp80
Harvey LAB-AA v1.1 → GDP.pdflinear62.8 pp4
MMMU-Pro → RealWorldQAMichaelis–Menten + offset122.8 pp23
Terminal-Bench 4.1 → Terminal-Bench Hardlinear52.8 pp45
HMMT Feb 2026 → HMMT Nov 2025Hill102.8 pp10
DynaMath → CountBenchMichaelis–Menten72.8 pp0
Video-MME (with subtitle) → RealWorldQAoffset logistic102.8 pp0
HealthBench Professional (raw, Artificial Analysis) → CritPtHill62.8 pp0
OmniDocBench 1.5 → RealWorldQAMichaelis–Menten + offset92.9 pp0
CharXiv → Video-MME (with subtitle)Michaelis–Menten102.9 pp25
When2Call (Decision Index) → Artificial Analysis Decision IndexHill142.9 pp2
CharXiv w/o tools → ERQAinverse Michaelis–Menten52.9 pp13
PinchBench → BFCL v4Michaelis–Menten52.9 pp2
Video-MME (with subtitle) → ERQAoffset logistic82.9 pp3
BrowseComp → DRACOlinear52.9 pp25
AA-Omniscience Accuracy → Vals MMLU-ProHill682.9 pp44
OCRBench V2 → RealWorldQAlinear62.9 pp0
GDPval-AA → Hermes BenchMichaelis–Menten132.9 pp86
OSWorld 2.0 → APEX-Agents-AAMichaelis–Menten + offset52.9 pp19
Vals LiveCodeBench → SciCodeHill72.9 pp53
Vibe Code Bench → SWE-bench Prolinear142.9 pp0
CountBench → DynaMathMichaelis–Menten72.9 pp0
AA-Omniscience Accuracy → GPQA DiamondMichaelis–Menten + offset462.9 pp0
BabyVision w/ Python → CharXiv w/o toolsMichaelis–Menten + offset62.9 pp0
DeepSearchQA → ResearchClawBenchMichaelis–Menten62.9 pp1
AA-MMMU-Pro → RealWorldQAMichaelis–Menten + offset92.9 pp38
HLE-MultiChoice (Decision Index) → Artificial Analysis Decision Indexoffset logistic142.9 pp0
MMVU → MMMUHill52.9 pp1
Vals GPQA Diamond → Vals MMLU-Prolinear852.9 pp0
BlenderWorld (text-only) → Cookie-BenchMichaelis–Menten + offset72.9 pp0
V* → RealWorldQAMichaelis–Menten62.9 pp0
MMMLU → CritPtlinear62.9 pp3
ZeroBench → CharXiv w/o toolsMichaelis–Menten52.9 pp0
AIME 2025 → HMMT Feb 2025offset logistic82.9 pp25
LifeVal → BrowseCompMichaelis–Menten52.9 pp2
Chartography (tools) → OfficeQA ProMichaelis–Menten72.9 pp3
HLE w/o tools → Vals GPQA DiamondMichaelis–Menten212.9 pp7
CharXiv w/o tools → AA-MMMU-Prolinear112.9 pp1
AA-MMMU-Pro → CountBenchMichaelis–Menten52.9 pp59
HLE-Verified → ARC-AGI-2Hill52.9 pp0
ApprenticeBench → BrowseCompHill112.9 pp2
Bug Hunt Bench → AA Coding IndexHill102.9 pp0
AI2D_TEST → CharXivinverse Michaelis–Menten73.0 pp1
ApprenticeBench → Gert Labslinear53.0 pp11
SWE-bench Pro → FrontierCode 1.1 ExtendedMichaelis–Menten63.0 pp64
PostTrainBench → FrontierCode 1.1 MainMichaelis–Menten63.0 pp10
SuperGPQA → Artificial Analysis Intelligence Indexoffset logistic123.0 pp9
MMMU-Pro → MathVisionlinear203.0 pp35
MMMU-Pro → CountBenchMichaelis–Menten83.0 pp11
Decision Index Arts → When2Call (Decision Index)Hill113.0 pp72
Vibe Code Bench → React Native EvalsMichaelis–Menten73.0 pp25
ZeroBench w/ Python → BabyVision w/ Pythonlinear53.0 pp2
CursorBench 3.2 → CursorBench 4.0linear83.0 pp1
AA-MMMU-Pro → DynaMathoffset logistic53.0 pp51
FrontierSWE v2 → AA Coding IndexHill133.0 pp0
MathVision → MMMU-ProMichaelis–Menten + offset203.0 pp1
CursorBench 4.0 → FrontierCode 1.1 ExtendedHill73.0 pp8
PostTrainBench v1.1 → AA Coding Indexlinear123.0 pp0
MMMU-Pro → Video-MME (with subtitle)Michaelis–Menten123.0 pp25
MMMU → AA-MMMU-Prooffset logistic153.0 pp8
DynaMath → AA-MMMU-Proinverse Michaelis–Menten53.0 pp0
ExtractBench Pro → AA-MMMU-ProMichaelis–Menten + offset53.0 pp2
AA-GPQA Diamond → Vals MMLU-ProMichaelis–Menten743.0 pp25
PerceptionBench → MMMU-Prolinear63.0 pp0
SEC-Bench Pro → FACTS MultimodalHill83.0 pp2
ExploitGym → BrowseComplinear73.0 pp12
Artificial Analysis Intelligence Index → MMMLUlinear73.0 pp3
OSWorld 2.0 → OSWorld-Verifiedlinear93.0 pp1
SWE-Marathon → AA-SciCodeoffset logistic73.0 pp2
CursorBench 4.0 → Vals LiveCodeBenchlinear83.0 pp9
SciCode → AA-SciCodelinear203.0 pp15
CursorBench 3.2 → AA Coding Indexlinear173.0 pp0
GDPval-AA → Toolathlon-VerifiedMichaelis–Menten143.1 pp41
Hermes Bench → HLE w/ toolsinverse Michaelis–Menten83.1 pp7
BioBasicsBench → ARC-AGI-3Hill63.1 pp1
Toolathlon-Verified → DRACOMichaelis–Menten73.1 pp0
Vibe Code Bench → PostTrainBench v1Hill103.1 pp29
Gert Labs → ApprenticeBenchlinear53.1 pp15
CharXiv → MMMU-ProMichaelis–Menten303.1 pp7
HLE w/ tools → τ²-bench resultsHill83.1 pp29
AA Tau3 Banking → CyberGymMichaelis–Menten73.1 pp13
AA-MMMU-Pro → ERQAoffset logistic113.1 pp65
AA-MMMU-Pro → MathVisionHill153.1 pp49
ExploitGym → MKAMichaelis–Menten83.1 pp14
FrontierMath v2 (Tiers 1-3) → HMMT Feb 2026linear113.1 pp27
ARC-AGI-2 → LABBench2Michaelis–Menten63.1 pp1
VulcanBench Frontier v4 → CursorBench 3.2inverse Michaelis–Menten53.1 pp6
RealWorldQA → RefCOCO (avg)Michaelis–Menten83.1 pp9
AIME26 → MATH-500linear53.1 pp26
Artificial Analysis Decision Index v1.0 → Artificial Analysis Decision Indexlinear143.1 pp0
AA MMLU-Pro → Vals GPQA Diamondinverse Michaelis–Menten103.1 pp3
MazeBench → Hermes Indexoffset logistic133.1 pp30
AA-SciCode → SciCodelinear203.1 pp66
GDPval-AA → AA Agentic Indexinverse Michaelis–Menten693.1 pp61
MKA → GDP.pdfHill153.1 pp5
NL2Repo → AA-SciCodeMichaelis–Menten + offset163.1 pp16
BabyVision → CharXivMichaelis–Menten103.2 pp1
CWE-bench → MKAMichaelis–Menten143.2 pp3
MMMU → CountBenchHill103.2 pp10
AA Coding Index → React Native Evalslinear93.2 pp54
Artificial Analysis Decision Index v1.0 → When2Call (Decision Index)Hill193.2 pp0
StealthMark → DAYJOBlinear123.2 pp18
VulcanBench Frontier v4 → AA Coding IndexMichaelis–Menten + offset63.2 pp1
AIME26 → HMMT Nov 2025Hill103.2 pp7
Mystery Game Puzzles → DAYJOBoffset logistic193.2 pp26
PostTrainBench v1 → SWE-bench Verifiedlinear63.2 pp5
MMLU-ProX → SWE Multilingualinverse Michaelis–Menten83.2 pp4
SimpleVQA → MMMUHill93.2 pp0
BabyVision w/ Python → AA-MMMU-ProMichaelis–Menten + offset63.2 pp0
AA-GPQA Diamond → Vals GPQA Diamondlinear743.2 pp100
MMMU → Video-MME (with subtitle)Michaelis–Menten83.2 pp12
Decision Index Arts → Artificial Analysis Decision Index v1.0Michaelis–Menten113.2 pp72
SWE-Marathon → Bug Hunt Benchlinear53.2 pp4
ResearchClawBench → Claw-EvalHill123.2 pp2
HLE w/o tools → GPQAHill303.2 pp3
Vals SWE-bench → OpenHarmony Bench v1.0linear113.2 pp20
Terminal-Bench 4.1 → Terminal-Bench 3.0linear103.2 pp35
MMLU → Artificial Analysis Intelligence Indexlinear143.2 pp17
RealWorldQA → CharXivinverse Michaelis–Menten123.3 pp3
CyberGym → AA Tau3 Bankingoffset logistic73.3 pp10
VulcanBench v3 → CursorBench 3.2Michaelis–Menten83.3 pp5
MathVision → MMVUlinear73.3 pp5
ExploitBench Internal Port → FACTS Multimodallinear63.3 pp0
SWE-bench Pro → CursorBench 4.0linear93.3 pp53
CharXiv → MathVisionMichaelis–Menten223.3 pp6
Decision Index Knowledge → Decision Index Full ScoreHill1103.3 pp0
VideoMMMU → RealWorldQAHill113.3 pp0
AutomationBench → AA Tau3 BankingMichaelis–Menten73.3 pp16
AA-Omniscience Accuracy → MMMLUoffset logistic53.3 pp0
PostTrainBench v1.1 → CursorBench 4.0Michaelis–Menten53.3 pp1
AA Agentic Index → GDPval-AAMichaelis–Menten693.3 pp0
VulcanBench Frontier v4 → PostTrainBenchHill53.3 pp8
MMMU-Pro → OCRBench V2Michaelis–Menten83.3 pp41
FrontierCode 2.0 → CursorBench 4.0Hill133.3 pp13
Toolathlon-Verified → AA Agentic Indexlinear73.3 pp9
CyberGym → Agents' Last ExamMichaelis–Menten + offset93.3 pp15
AA-HLE → MMLU-ReduxMichaelis–Menten93.3 pp19
HealthBench (raw) → HealthBench ProfessionalMichaelis–Menten83.4 pp0
ARC-AGI-3 Provider Adapter → ARC-AGI-1linear123.4 pp1
MMLU-Pro → MMMLUMichaelis–Menten53.4 pp1
OpenHarmony Bench v1.0 → AA Coding Indexoffset logistic103.4 pp0
We-Math → MLVU (M-Avg)offset logistic63.4 pp0
LiveCodeBench v6 → NL2RepoHill123.4 pp23
MCP-Tasks → Claw-Evaloffset logistic53.4 pp0
CWE-Bench-AA → Hermes BenchHill103.4 pp0
CritPt → GPQA DiamondMichaelis–Menten + offset523.4 pp1
HMMT Nov 2025 → HMMT Feb 2026Hill103.4 pp1
Vibe Code Bench → AA LiveCodeBenchlinear73.4 pp8
LiveCodeBench v6 → Vals LiveCodeBenchoffset logistic73.4 pp19
CWE-bench → Hermes IndexHill73.4 pp1
Vals SWE-bench → CursorBench 4.0offset logistic93.4 pp18
AA-HLE → HealthBench (length-adjusted)linear83.4 pp80
VulcanBench v3 → FrontierCode 1.1 Extendedoffset logistic53.4 pp1
AA-SciCode → CursorBench 3.1linear53.4 pp73
MRCRv2 → AA-LCRHill93.4 pp5
OpenHarmony Bench v1.0 → AA-SciCodeMichaelis–Menten113.4 pp0
AA-HLE → CritPtoffset logistic2003.4 pp9
GPQA Diamond → MMLU-Pro (Arcee)Michaelis–Menten63.4 pp80
ARC-AGI-3 → ARC-AGI-1offset logistic213.4 pp0
AA Coding Index → FrontierCode 1.1 ExtendedMichaelis–Menten + offset63.4 pp3
AA Coding Index → AA-SciCodelinear743.4 pp20
MLVU (M-Avg) → RefCOCO (avg)offset logistic63.4 pp0
OSWorld 2.1 Offline → MKAoffset logistic93.4 pp2
AIME 2024 → AIME 2025inverse Michaelis–Menten173.5 pp11
NL2Repo → SWE-bench ProHill283.5 pp8
ApprenticeBench → APEX-Agents-AAlinear53.5 pp3
MLVU (M-Avg) → MathVisionHill83.5 pp0
MKA → Hermes Benchlinear103.5 pp0
ARC-AGI-3 → BioBasicsBenchlinear63.5 pp3
WildGuardTest (Decision Index) → Artificial Analysis Decision Indexinverse Michaelis–Menten143.5 pp0
BrowseComp → WideResearchMichaelis–Menten113.5 pp29
Video-MME (w/o subtitle) → Video-MME (with subtitle)Michaelis–Menten73.5 pp0
GDP.pdf → Harvey LAB-AA v1.1linear63.5 pp15
FrontierCode 2.0 → AA-SciCodeHill213.5 pp7
DeepSWE → FrontierCode 1.1 MainMichaelis–Menten + offset73.5 pp33
BioBasicsBench → AA-HLEMichaelis–Menten73.5 pp0
MMMU → RealWorldQAMichaelis–Menten123.5 pp10
Artificial Analysis Decision Index → Decision Index Knowledgeinverse Michaelis–Menten113.5 pp11
Artificial Analysis Decision Index v1.0 → Decision Index ArtsHill113.5 pp0
DAYJOB → StealthMarkMichaelis–Menten + offset123.5 pp5
HealthBench Professional → Vals MMLU-ProHill63.5 pp1
PostTrainBench v1.1 → AA-SciCodeHill133.5 pp0
FrontierMath v2 (Tier 4) → FrontierMath v2 (Tiers 1-3)Michaelis–Menten + offset583.5 pp0
Video-MME (with subtitle) → We-Mathoffset logistic63.5 pp3
SWE-bench Pro → SWE-bench Verifiedlinear513.6 pp19
SWE-bench Pro → CursorBench 3.2Hill123.6 pp61
PostTrainBench v1 → SWE-bench Prooffset logistic93.6 pp0
SimpleQA → MMLU-ProMichaelis–Menten83.6 pp7
BrowseComp → AA Tau3 Bankinginverse Michaelis–Menten103.6 pp26
MMMU → MathVisionlinear103.6 pp10
CharXiv → MMVUMichaelis–Menten + offset63.6 pp14
MathVision → PerceptionBenchinverse Michaelis–Menten53.6 pp12
Video-MME (w/o subtitle) → VideoMMMUinverse Michaelis–Menten83.6 pp0
SWE-bench Verified → SWE-Rebenchoffset logistic83.6 pp84
IFBench → IFEvalHill223.6 pp28
MathVision → ZeroBenchoffset logistic63.6 pp14
RealWorldQA → CountBenchMichaelis–Menten103.6 pp2
ZeroBench → ScreenSpot ProHill53.6 pp6
ZeroBench w/ Python → MMMU-ProMichaelis–Menten63.6 pp0
AI2D_TEST → Video-MME (with subtitle)Michaelis–Menten63.6 pp0
Vals SWE-bench → PostTrainBench v1linear103.6 pp33
AA MMLU-Pro → Artificial Analysis Intelligence Indexlinear123.6 pp1
BrowseComp → PinchBenchMichaelis–Menten53.6 pp58
Hermes Index → Hermes BenchMichaelis–Menten163.6 pp0
SWE-bench Verified → SciCodeMichaelis–Menten203.6 pp65
Vals GPQA Diamond → AA-GPQA Diamondlinear743.6 pp9
τ³-bench results → MCP-TasksHill53.6 pp6
OSWorld-Verified → OSWorld 2.0linear93.6 pp0
ProgramBench → CursorBench 3.2Michaelis–Menten53.6 pp8
V* → CharXivoffset logistic123.6 pp1
SWE-bench Pro → AA-SciCodelinear433.6 pp15
CursorBench 3.1 → AA Coding IndexHill53.6 pp1
JobBench → APEX-Agents-AAMichaelis–Menten53.6 pp25
ARC-AGI-3 → HealthBench Professionallinear123.6 pp8
Hermes Bench → DRACOMichaelis–Menten53.7 pp0
CharXiv → CountBenchMichaelis–Menten63.7 pp8
Artificial Analysis Intelligence Index → HealthBench (length-adjusted)offset logistic83.7 pp72
CharXiv w/o tools → BabyVision w/ PythonMichaelis–Menten63.7 pp10
MathVision → MMMUHill103.7 pp3
MathVision → BabyVisioninverse Michaelis–Menten93.7 pp15
Vals SWE-bench → PostTrainBenchHill123.7 pp40
OmniDocBench 1.5 → CC-OCRinverse Michaelis–Menten63.7 pp4
AA Agentic Index → AA Tau3 Bankinglinear153.7 pp31
SWE-bench Pro → PostTrainBenchinverse Michaelis–Menten93.7 pp39
Vals SWE-bench → PostTrainBench v1.1Hill103.7 pp44
AA-MMMU-Pro → Video-MME (with subtitle)Michaelis–Menten83.7 pp40
INCLUDE → SWE Multilingualoffset logistic73.7 pp1
AA-SciCode → cursorBench41offset logistic93.7 pp61
ParseBench-2 → ParseBench-1linear163.7 pp5
DeepPlanning → QwenClawBenchlinear73.7 pp0
FrontierSWE v2 → AA-SciCodeMichaelis–Menten203.7 pp0
Hermes Index → MKAMichaelis–Menten103.7 pp2
SuperGPQA → AA-GPQA Diamondoffset logistic173.7 pp4
MCP Atlas → AA-AnalystAgentoffset logistic63.7 pp29
CursorBench 4.0 → Vals SWE-benchlinear93.7 pp9
ExploitGym → MazeBenchoffset logistic153.7 pp8
CharXiv → MMMUHill133.7 pp8
AA-Omniscience Accuracy → BioBasicsBenchoffset logistic73.8 pp46
Vibe Code Bench → AA-SciCodelinear113.8 pp17
MMMU → MMVUMichaelis–Menten53.8 pp12
AA-GPQA Diamond → CritPtoffset logistic1763.8 pp3
CharXiv w/o tools → PerceptionBenchoffset logistic63.8 pp8
ScreenSpot Pro → CharXivMichaelis–Menten143.8 pp6
DeepSWE → ScarfBenchHill93.8 pp56
SimpleQA → MMLUMichaelis–Menten73.8 pp1
HMMT Feb 2026 → AIME 2025offset logistic53.8 pp5
MazeBench → LifeValoffset logistic63.8 pp26
MazeBench → Finance Agent v2offset logistic63.8 pp49
MLVU (M-Avg) → AA-MMMU-Prooffset logistic73.8 pp0
Artificial Analysis Intelligence Index → MMLUoffset logistic143.8 pp13
RealWorldQA → CharXiv w/o toolsHill53.8 pp1
AA-GPQA Diamond → MMLU-Reduxlinear93.8 pp0
ProgramBench → DeepSWEoffset logistic193.8 pp2
MathVision → CharXivlinear223.8 pp1
FrontierSWE v2 → FrontierCode 1.1 MainMichaelis–Menten73.8 pp3
MMMU-Pro → BabyVision w/ Pythonoffset logistic53.8 pp40
HLE-Verified → AA-HLEoffset logistic63.8 pp0
FrontierCode 1.1 Main → AA-SciCodelinear113.8 pp0
SimpleVQA → RealWorldQAMichaelis–Menten113.8 pp0
SWE-bench Verified → AA-SciCodeMichaelis–Menten353.8 pp42
SimpleVQA → CountBenchlinear83.8 pp0
MKA → CWE-Bench-AAoffset logistic113.8 pp11
Claw-Eval → OSWorld-VerifiedHill93.8 pp32
ExploitBench → SEC-Bench ProMichaelis–Menten93.9 pp9
DeepSWE → AA-SciCodeMichaelis–Menten403.9 pp9
PostTrainBench → Vals SWE-benchlinear123.9 pp6
FrontierCode 2.0 → FrontierCode 1.1 Mainlinear103.9 pp2
FrontierPhysics → DAYJOBinverse Michaelis–Menten123.9 pp1
VideoMMMU → Video-MME (with subtitle)Michaelis–Menten + offset113.9 pp0
GPQA Diamond → AA-HLEinverse Michaelis–Menten503.9 pp36
Terminal-Bench 2.1 (Vals AI) → Terminal-Bench HardHill133.9 pp27
HLE w/o tools → ARC-AGI-1Hill143.9 pp13
Toolathlon-Verified → WideResearchMichaelis–Menten63.9 pp5
Bug Hunt Bench → VulcanBench v3offset logistic73.9 pp20
AA Agentic Index → AA ITBenchlinear174.0 pp40
MCP Atlas → DRACOMichaelis–Menten64.0 pp4
Terminal-Bench 3.0 → Terminal-Bench 2.1 (Vals AI)linear114.0 pp0
MMLU → MMLU-Proinverse Michaelis–Menten194.0 pp13
We-Math → Video-MME (with subtitle)Hill64.0 pp0
AA-MMMU-Pro → BabyVision w/ PythonMichaelis–Menten64.0 pp33
Artificial Analysis Decision Index → Artificial Analysis Decision Index v1.0Hill144.0 pp5
CritPt → MMLU-Pro (Arcee)linear64.0 pp107
DeepsecBench-AA → BrowseCompMichaelis–Menten84.0 pp3
CyberGym → ApprenticeBenchoffset logistic84.0 pp17
AIME26 → HMMT Feb 2026inverse Michaelis–Menten224.0 pp11
AA Coding Index → VulcanBench Frontier v4Michaelis–Menten + offset64.0 pp10
NYT Connections → FACTS Multimodallinear224.0 pp52
GPQA → CritPtoffset logistic844.0 pp47
Terminal-Bench 2.0 → Terminal-Bench HardHill124.0 pp16
AA-AnalystAgent → Harvey LAB-AA v1.1offset logistic64.0 pp12
Toolathlon-Verified → MazeBenchlinear104.0 pp6
CWE-bench → CWE-Bench-AAHill94.0 pp3
Chess Puzzles → BlenderWorld (text-only)offset logistic54.0 pp19
MLVU (M-Avg) → Video-MME (w/o subtitle)inverse Michaelis–Menten74.0 pp0
FrontierMath v2 (Tiers 1-3) → FrontierMath v2 (Tier 4)inverse Michaelis–Menten584.0 pp13
DeepsecBench-AA → Hermes BenchMichaelis–Menten104.0 pp0
Furniture Assembly → DAYJOB Healthcarelinear164.0 pp19
MMLU-Pro → CritPtinverse Michaelis–Menten494.1 pp4
FrontierCode 2.0 → CursorBench 3.2Hill64.1 pp7
GDPval-AA → AA Tau3 BankingMichaelis–Menten174.1 pp38
BrowseComp → SkillsBenchinverse Michaelis–Menten54.1 pp52
Cookie-Bench → BlenderWorld (text-only)inverse Michaelis–Menten74.1 pp0
PostTrainBench v1.1 → Vals SWE-benchHill104.1 pp1
LABBench2 → AA-HLEoffset logistic74.1 pp0
HMMT Feb 2026 → FrontierMath v2 (Tier 4)linear64.1 pp11
AA-MMMU-Pro → Chartography (tools)Michaelis–Menten54.1 pp70
FrontierSWE v2 → CursorBench 3.2Hill74.1 pp0
EBR-bench → DAYJOBHill114.1 pp0
MCP-Tasks → DeepPlanninginverse Michaelis–Menten54.1 pp0
HealthBench (length-adjusted) → HealthBench Professional (raw)Hill84.1 pp0
BioBasicsBench → ARC-AGI-1Michaelis–Menten74.1 pp0
CursorBench 4.0 → DeepSWEMichaelis–Menten + offset164.1 pp5
JobBench → GDP.pdfoffset logistic54.1 pp31
BrowseComp → AA ITBenchMichaelis–Menten104.1 pp31
Mystery Game Puzzles → OTelBenchMichaelis–Menten54.1 pp26
Chartography (tools) → AA-MMMU-ProMichaelis–Menten54.1 pp0
ScarfBench → PostTrainBenchlinear74.1 pp1
MathVision → DynaMathlinear64.1 pp1
APEX-Agents-AA → HLE w/ toolsHill54.1 pp21
MMLU-Redux → SuperGPQAHill94.1 pp6
CursorBench 4.0 → SWE-bench ProHill94.2 pp8
CountBench → RealWorldQAinverse Michaelis–Menten104.2 pp0
RealWorldQA → MLVU (M-Avg)inverse Michaelis–Menten104.2 pp1
BBH → GPQAlinear74.2 pp0
OSWorld 2.1 → GDPval-AAlinear94.2 pp3
Artificial Analysis Intelligence Index → Vals MMLU-ProMichaelis–Menten724.2 pp2
RealWorldQA → ERQAHill114.2 pp3
HLE w/o tools → HealthBench ProfessionalMichaelis–Menten + offset64.2 pp38
ERQA → MedXpertQA (MM)Hill74.2 pp5
GPQA → HealthBench ProfessionalHill74.2 pp15
GPQA Diamond → HealthBench ProfessionalHill74.2 pp6
Video-MME (with subtitle) → MMMU-Proinverse Michaelis–Menten124.2 pp0
Vals SWE-bench → AA-SciCodelinear424.2 pp2
BrowseComp → Toolathloninverse Michaelis–Menten134.2 pp45
Artificial Analysis Intelligence Index → HealthBench ProfessionalHill194.2 pp118
APEX-Agents-AA → BrowseCompMichaelis–Menten + offset124.2 pp16
HLE-MultiChoice (Decision Index) → Artificial Analysis Decision Index v1.0Michaelis–Menten194.2 pp0
SWE-bench Verified → FrontierCode 1.1 Mainlinear74.2 pp67
Bug Hunt Bench → AA-SciCodeMichaelis–Menten234.2 pp0
GPQA → MMLUHill264.2 pp29
Mystery Game Puzzles → DAYJOB Healthcareoffset logistic194.2 pp33
FrontierSWE v2 → cursorBench41linear124.3 pp1
FrontierSWE v2 → PostTrainBench v1.1linear74.3 pp1
PostTrainBench v1.1 → DeepSWEMichaelis–Menten94.3 pp5
ParseBench-1 → ParseBench-2Michaelis–Menten164.3 pp8
GPQA Diamond → HLE w/o toolsoffset logistic364.3 pp32
ARC-AGI-2 → HealthBench ProfessionalHill134.3 pp1
EBR-bench → MaxxBenchMichaelis–Menten54.3 pp25
Hermes Index → CWE-benchMichaelis–Menten + offset74.3 pp9
Artificial Analysis Intelligence Index → HealthBench Professional (length-adjusted, Artificial Analysis)linear64.3 pp145
Video-MME (w/o subtitle) → CountBenchoffset logistic64.3 pp0
MLVU (M-Avg) → CharXivHill94.3 pp0
NL2Repo → AA Coding IndexHill154.3 pp11
PostTrainBench → SWE-bench ProHill94.3 pp8
FrontierSWE v2 → DeepSWEMichaelis–Menten + offset194.3 pp3
NYT Connections → BlenderWorld (text-only)Hill54.3 pp10
ExploitBench Internal Port → FrontierPhysicslinear74.3 pp1
OfficeQA Pro → Chartography (tools)Michaelis–Menten74.3 pp3
CritPt → Vals MMLU-ProHill704.3 pp1
AIME 2025 → AIME26linear74.3 pp35
FrontierCode 1.1 Main → PostTrainBenchinverse Michaelis–Menten64.3 pp3
Vibe Code Bench → FrontierCode 1.1 Maininverse Michaelis–Menten54.3 pp5
Hermes Index → HLE w/ toolslinear84.3 pp1
AA-Omniscience Accuracy → SimpleQAlinear74.3 pp0
VulcanBench Frontier v4 → AA-SciCodeMichaelis–Menten + offset184.3 pp0
Hermes Bench → AA Agentic IndexHill54.3 pp0
Toolathlon → BrowseComplinear134.3 pp3
DynaMath → MLVU (M-Avg)Michaelis–Menten + offset74.3 pp0
Hermes Index → DRACOMichaelis–Menten54.3 pp0
PhysicianBench → HealthBench (raw, Artificial Analysis)Michaelis–Menten + offset54.3 pp0
ARC-AGI-3 → ARC-AGI-3 Provider AdapterMichaelis–Menten134.4 pp4
HLE w/o tools → HealthBench Professional (length-adjusted, Artificial Analysis)Hill54.4 pp20
Vals SWE-bench → SWE-bench Verifiedlinear264.4 pp21
AA Coding Index → CursorBench 3.2inverse Michaelis–Menten174.4 pp17
Video-MME (w/o subtitle) → MLVU (M-Avg)Hill74.4 pp0
SWE-bench Pro → PostTrainBench v1.1inverse Michaelis–Menten104.4 pp39
Furniture Assembly → FrontierPhysicsinverse Michaelis–Menten244.4 pp15
HealthBench (length-adjusted) → ARC-AGI-1Michaelis–Menten64.4 pp1
DeepsecBench-AA → GDP.pdflinear114.4 pp3
LifeVal → MazeBenchoffset logistic64.4 pp0
ApprenticeBench → AA ITBenchMichaelis–Menten + offset94.4 pp0
Decision Index Full Score → Decision Index LanguageHill1104.4 pp0
ARC-AGI-1 → HealthBench Professionaloffset logistic134.4 pp0
CountBench → CC-OCRMichaelis–Menten54.4 pp0
GPQA → MMLU-ProHill624.4 pp35
C-Eval → Artificial Analysis Intelligence Indexoffset logistic54.4 pp4
MKA → CWE-benchlinear144.4 pp2
AI2D_TEST → Video-MME (w/o subtitle)Michaelis–Menten + offset74.4 pp0
GPQA Diamond → AA-GPQA DiamondHill414.4 pp23
MCP Atlas → AA ITBenchMichaelis–Menten + offset94.4 pp6
SciCode → LiveCodeBench v6Hill144.4 pp9
FrontierCode 1.1 Main → AA Coding IndexMichaelis–Menten94.4 pp1
BrowseComp → APEX-Agents-AAHill124.4 pp37
SWE-bench Verified → SWE-bench Prolinear514.5 pp60
GPQA → Vals GPQA Diamondlinear414.5 pp34
Vals GPQA Diamond → GPQAlinear414.5 pp24
MMVU → MMMU-Proinverse Michaelis–Menten74.5 pp0
Terminal-Bench 4.1 → Terminal-Bench 4.0linear174.5 pp23
AA-HLE → Vals MMLU-ProMichaelis–Menten744.5 pp0
GPQA Diamond → MedXpertQA (Text)inverse Michaelis–Menten54.5 pp60
DeepSWE → PostTrainBench v1.1inverse Michaelis–Menten94.5 pp21
Vals SWE-bench → SciCodeMichaelis–Menten84.5 pp3
LifeVal → AA-AnalystAgentinverse Michaelis–Menten54.5 pp0
Artificial Analysis Decision Index → Decision Index Artslinear114.5 pp5
Video-MME (w/o subtitle) → MathVisionlinear64.5 pp0
JobBench → Claw-Evallinear74.5 pp28
MCP Atlas → AA Tau3 BankingMichaelis–Menten74.5 pp2
FrontierCode 2.0 → PostTrainBenchHill154.5 pp3
ApprenticeBench → CyberGymlinear84.5 pp3
FrontierSWE v2 → ScarfBenchMichaelis–Menten74.5 pp6
Vibe Code Bench → SWE-bench Verifiedlinear114.5 pp9
Video-MME (with subtitle) → MathVisionlinear84.5 pp0
OSWorld 2.0 → CWE-Bench-AAlinear74.5 pp14
AA-HLE → HealthBench Professionaloffset logistic174.5 pp12
CursorBench 3.2 → SWE-bench ProHill124.5 pp3
AA Agentic Index → DeepSearchQAMichaelis–Menten84.5 pp61
FrontierCode 1.1 Main → DeepSWEMichaelis–Menten74.5 pp1
Vals LiveCodeBench → CursorBench 4.0inverse Michaelis–Menten84.5 pp10
GPQA → BBHoffset logistic74.5 pp9
HealthBench Professional (raw, Artificial Analysis) → Artificial Analysis Intelligence Indexlinear64.5 pp0
CursorBench 3.2 → CursorBench 3.1Michaelis–Menten54.5 pp0
ExploitGym → CWE-bench v1linear64.5 pp17
AA-HLE → HealthBench Professional (raw)Michaelis–Menten + offset84.5 pp103
HealthBench Hard → AA-GPQA DiamondHill84.5 pp0
OmniDocBench 1.5 → MathVisionHill84.5 pp0
MMMLU → GPQAoffset logistic144.6 pp0
DAYJOB → FrontierPhysicsinverse Michaelis–Menten124.6 pp3
OSWorld 2.0 → Gert LabsMichaelis–Menten54.6 pp5
SWE-bench Pro → PostTrainBench v1linear94.6 pp36
RefCOCO (avg) → CountBenchoffset logistic74.6 pp0
Hermes Bench → CWE-Bench-AAMichaelis–Menten104.6 pp1
Vals GPQA Diamond → HLE-Verifiedoffset logistic64.6 pp15
DRACO → GDPval-AAHill74.6 pp2
Decision Index Tools → Artificial Analysis Decision Index v1.0linear114.6 pp2
DynaMath → We-MathHill64.6 pp0
AA-AnalystAgent → CWE-benchHill94.6 pp12
GDPval-AA → GDP.pdfoffset logistic134.6 pp97
Toolathlon-Verified → CWE-benchoffset logistic54.6 pp7
AA Coding Index → FrontierCode 1.1 Maininverse Michaelis–Menten94.6 pp15
MKA → Hermes IndexHill104.6 pp1
GPQA Diamond → CritPtinverse Michaelis–Menten524.6 pp8
AutomationBench → CyberGymMichaelis–Menten114.6 pp16
AA Coding Index → SciCodelinear154.6 pp11
Terminal-Bench 4.0 → Terminal-Bench 4.1Hill174.6 pp13
RealWorldQA → Video-MME (with subtitle)inverse Michaelis–Menten104.6 pp1
SWE-bench Multimodal → ParseBench-1Hill54.6 pp2
HealthBench Professional (raw) → AA-HLEMichaelis–Menten + offset84.6 pp0
HLE w/o tools → AA-HLEoffset logistic364.6 pp6
Agents' Last Exam → AA Tau3 BankingHill64.6 pp1
CWE-bench → AA-AnalystAgentMichaelis–Menten94.6 pp6
Decision Index Knowledge → Artificial Analysis Decision Index v1.0Michaelis–Menten114.7 pp12
Decision Index Language → Decision Index Knowledgeinverse Michaelis–Menten1104.7 pp0
ERQA → Video-MME (with subtitle)Michaelis–Menten84.7 pp0
Artificial Analysis Intelligence Index → CritPtoffset logistic1544.7 pp6
StealthMark → FACTS MultimodalHill174.7 pp7
Vals SWE-bench → NL2RepoHill144.7 pp55
Artificial Analysis Decision Index v1.0 → Decision Index ToolsMichaelis–Menten114.7 pp8
MCP Atlas → BFCL v4Hill74.7 pp17
CompileBench → Mystery Game Puzzleslinear54.7 pp9
Decision Index Language → Decision Index Full Scorelinear1104.7 pp0
SWE-bench Pro → Vals LiveCodeBenchHill364.7 pp18
LiveCodeBench v6 → AA-SciCodeinverse Michaelis–Menten214.7 pp10
Artificial Analysis Decision Index → Decision Index ToolsMichaelis–Menten + offset114.7 pp5
Vals LiveCodeBench → SWE-bench Prooffset logistic364.7 pp10
CursorBench 4.0 → FrontierCode 2.0offset logistic134.7 pp8
When2Call (Decision Index) → Decision Index ToolsMichaelis–Menten114.7 pp0
AA Harvey LAB v1.0 → MazeBenchoffset logistic114.7 pp0
Decision Index Full Score → Artificial Analysis Decision Index v1.0Michaelis–Menten114.7 pp0
OSWorld-Verified → BrowseCompoffset logistic154.7 pp8
AA Coding Index → LiveCodeBench v6Michaelis–Menten214.7 pp32
C-Eval → GPQAlinear114.7 pp0
HLE-MultiChoice (Decision Index) → Decision Index Artsoffset logistic114.7 pp0
StealthMark → FrontierPhysicsHill204.7 pp18
Bug Hunt Bench → CursorBench 4.0linear174.7 pp2
CyberGym → OSWorld-VerifiedMichaelis–Menten104.7 pp13
StealthMark → DAYJOB Healthcarelinear124.7 pp11
AA Coding Index → NL2Repolinear154.7 pp35
AA Tau3 Banking → BrowseComplinear104.7 pp1
Vals SWE-bench → React Native EvalsMichaelis–Menten + offset74.7 pp6
FrontierPhysics → DAYJOB HealthcareMichaelis–Menten + offset124.7 pp1
OSWorld-Verified → AA ITBenchMichaelis–Menten + offset54.7 pp7
MazeBench → GDP.pdfHill184.7 pp2
AA Coding Index → AA LiveCodeBenchoffset logistic54.7 pp36
PolyMath → MAXIFEMichaelis–Menten54.7 pp1
ProgramBench → CursorBench 4.0Michaelis–Menten84.7 pp6
AA-SciCode → React Native Evalslinear64.7 pp29
HLE w/ tools → WideResearchlinear74.8 pp7
Terminal-Bench 3.0 → Terminal-Bench 4.1linear104.8 pp3
FrontierSWE v2 → FrontierCode 2.0Hill154.8 pp6
RealWorldQA → ScreenSpot Prolinear74.8 pp9
NYT Connections → Cookie-BenchHill54.8 pp10
ExploitBench Internal Port → Furniture Assemblyoffset logistic74.8 pp2
AA MMLU-Pro → AA-Omniscience Accuracylinear114.8 pp2
ExploitGym → AA AutomationBenchMichaelis–Menten74.8 pp16
AA Agentic Index → Hermes Benchlinear54.8 pp0
Bug Hunt Bench → PostTrainBench v1.1Michaelis–Menten74.8 pp1
SWE-Rebench → SWE-bench VerifiedMichaelis–Menten84.8 pp2
DeepSWE → SWE-Atlas Codebase QnAHill84.8 pp58
APEX-Agents → BrowseCompoffset logistic64.8 pp3
Vals MMLU-Pro → MMLU-ProMichaelis–Menten94.8 pp37
FrontierCode 2.0 → PostTrainBench v1.1linear94.8 pp2
PostTrainBench v1.1 → ProgramBenchoffset logistic54.8 pp10
AA Coding Index → CursorBench 3.1offset logistic54.8 pp9
FrontierSWE v2 → SWE-bench Prolinear94.8 pp2
Hermes Index → MazeBenchlinear134.8 pp1
FrontierSWE v2 → Vals SWE-benchMichaelis–Menten + offset124.9 pp1
CyberGym → HLE w/ toolsoffset logistic74.9 pp17
SWE-bench Pro → OpenHarmony Bench v1.0offset logistic74.9 pp14
AA-SciCode → CursorBench 4.0inverse Michaelis–Menten174.9 pp24
HealthBench (raw) → ARC-AGI-1linear64.9 pp0
OSWorld 2.0 → JobBenchMichaelis–Menten74.9 pp17
MathVision → Video-MME (w/o subtitle)Michaelis–Menten + offset64.9 pp3
LiveCodeBench v6 → SciCodeinverse Michaelis–Menten144.9 pp11
MMMU-Pro → PerceptionBenchMichaelis–Menten64.9 pp27
Vals MMLU-Pro → HLE w/o toolsoffset logistic214.9 pp54
Video-MME (with subtitle) → CharXivHill104.9 pp1
WideResearch → SkillsBenchHill64.9 pp2
AA AutomationBench → MKAHill164.9 pp6
APEX-Agents-AA → APEX-AgentsMichaelis–Menten + offset54.9 pp18
OSWorld 2.1 → HLE w/ toolsHill84.9 pp4
CharXiv → AA-MMMU-Prolinear314.9 pp5
AA-SciCode → LiveCodeBench v6linear214.9 pp22
Artificial Analysis Intelligence Index → HLE w/o toolslinear344.9 pp83
HLE-MultiChoice (Decision Index) → Decision Index ToolsHill114.9 pp0
LiveCodeBench Pro → SWE-bench Prooffset logistic64.9 pp0
AA-GPQA Diamond → HealthBench Professionaloffset logistic74.9 pp0
CyberGym → AA ITBenchMichaelis–Menten94.9 pp5
HealthBench Professional → HLE w/o toolsMichaelis–Menten + offset64.9 pp2
SWE-bench Pro → FrontierCode 1.1 MainMichaelis–Menten95.0 pp12
ARC-AGI-3 Provider Adapter → CritPtlinear95.0 pp0
Agents' Last Exam → BrowseCompHill65.0 pp1
CursorBench 3.1 → CursorBench 3.2Michaelis–Menten55.0 pp1
Bug Hunt Bench → PostTrainBenchHill135.0 pp1
MMMU-Pro → ParseBench-2inverse Michaelis–Menten55.0 pp44
DeepSWE → VulcanBench Frontier v4Michaelis–Menten + offset155.0 pp21
CyberGym → GDPval-AAHill185.0 pp10
React Native Evals → SWE-bench Verifiedoffset logistic75.0 pp2
SimpleVQA → MLVU (M-Avg)Michaelis–Menten105.0 pp2
ARC-AGI-3 → HLE w/o toolslinear115.0 pp0
APEX-Agents-AA → ApprenticeBenchlinear55.0 pp7
Mystery Game Puzzles → FrontierPhysicsHill255.0 pp26
MedXpertQA (Text) → HLE w/o toolsMichaelis–Menten55.0 pp0
Mystery Game Puzzles → FailureSensorIQMichaelis–Menten + offset95.0 pp5
AA-Omniscience Accuracy → MMLU-ProHill315.0 pp54
VulcanBench Frontier v4 → CursorBench 4.0Hill105.0 pp0
BFCL v4 → PinchBenchinverse Michaelis–Menten55.0 pp15
FrontierCode 2.0 → ScarfBenchoffset logistic75.0 pp6
HLE-MultiChoice (Decision Index) → Decision Index Knowledgeoffset logistic115.1 pp2
AA ITBench → ToolathlonMichaelis–Menten75.1 pp10
SuperGPQA → HLEoffset logistic135.1 pp8
GDPval-AA → AA ITBenchHill225.1 pp40
OfficeQA Pro → CharXivoffset logistic65.1 pp9
WildGuardTest (Decision Index) → Artificial Analysis Decision Index v1.0offset logistic195.1 pp0
GPQA → HealthBench Hardoffset logistic65.1 pp38
Vals MMLU-Pro → GPQAlinear405.1 pp1
AI2D_TEST → We-MathHill55.1 pp2
MLVU (M-Avg) → MMMUinverse Michaelis–Menten85.1 pp0
OSWorld 2.1 Offline → CWE-benchMichaelis–Menten75.1 pp0
JobBench → MazeBenchinverse Michaelis–Menten115.1 pp20
CursorBench 3.2 → VulcanBench v3Michaelis–Menten + offset85.1 pp6
Decision Index Tools → Decision Index Knowledgeinverse Michaelis–Menten1105.1 pp0
ResearchClawBench → OSWorld-VerifiedHill105.1 pp3
HealthBench (raw) → AA-HLEMichaelis–Menten85.1 pp0
ApprenticeBench → MazeBenchMichaelis–Menten + offset165.1 pp0
Vals LiveCodeBench → AA-SciCodeMichaelis–Menten + offset385.1 pp5
Terminal-Bench-Science 0.1 → Terminal-Bench 4.1Michaelis–Menten125.1 pp0
SimpleVQA → MMMU-ProHill165.1 pp0
ARC-AGI-2 → CritPtHill395.1 pp2
CWE-bench v1 → GDPval-AAHill105.1 pp0
CursorBench 3.2 → PostTrainBench v1.1Hill85.1 pp0
WideResearch → JobBenchlinear55.1 pp8
HealthBench Professional (length-adjusted, Artificial Analysis) → CritPtMichaelis–Menten65.1 pp0
ARC-AGI-2 → BioBasicsBenchoffset logistic75.1 pp5
DeepSWE → SWE-bench VerifiedHill125.1 pp22
ScreenSpot Pro → CharXiv w/o toolsMichaelis–Menten55.1 pp4
DeepsecBench-AA → HLE w/ toolsoffset logistic85.1 pp4
MazeBench → CWE-bench v1offset logistic105.1 pp36
WildGuardTest (Decision Index) → Decision Index Languageoffset logistic115.2 pp8
NL2Repo → Vals SWE-benchlinear145.2 pp19
MirrorCode → DAYJOB Healthcarelinear165.2 pp0
AA Cyber Index → CWE-Bench-AAoffset logistic215.2 pp0
CyberGym → BrowseCompMichaelis–Menten + offset155.2 pp4
WideResearch → ToolathlonHill75.2 pp2
OmniDocBench 1.5 → CharXivoffset logistic105.2 pp0
ScreenSpot Pro → ParseBench-1Michaelis–Menten + offset65.2 pp12
SingleCellBench → Protocols (troubleshooting)linear55.2 pp0
Hermes Bench → MKAoffset logistic105.2 pp0
MMLU-Pro → GPQA DiamondHill255.2 pp0
CursorBench 3.1 → Vals SWE-benchlinear75.2 pp0
Vals SWE-bench → SWE-bench ProMichaelis–Menten + offset385.2 pp0
BioMysteryBench (human-solvable) → AA-HLEHill55.2 pp0
ARC-AGI-1 → ARC-AGI-2inverse Michaelis–Menten415.2 pp1
Mystery Game Puzzles → ExploitBench Internal PortHill75.2 pp12
AI2D_TEST → RealWorldQAHill75.2 pp0
Toolathlon-Verified → DeepsecBench-AAHill85.2 pp10
Vals SWE-bench → FrontierCode 1.1 MainHill95.2 pp7
MMMU → ERQAoffset logistic65.2 pp16
CWE-bench → CWE-bench v1Michaelis–Menten75.2 pp2
HLE w/ tools → CWE-Bench-AAHill85.2 pp23
DeepsecBench-AA → MKAlinear115.2 pp1
Decision Index Language → Artificial Analysis Decision Index v1.0Michaelis–Menten115.3 pp2
SWE-bench Verified → AA Coding Indexoffset logistic345.3 pp61
ERQA → CharXivMichaelis–Menten175.3 pp0
GDPval-AA → HLE w/ toolslinear195.3 pp74
SciCode → Vals SWE-benchHill85.3 pp21
Vals GPQA Diamond → CritPtoffset logistic705.3 pp8
AA-SciCode → CursorBench 3.2linear175.3 pp19
Decision Index Tools → Decision Index Full ScoreHill1105.3 pp0
GPQA → HLE w/o toolsoffset logistic305.3 pp31
WildGuardTest (Decision Index) → Decision Index ToolsHill115.3 pp0
ExploitBench Internal Port → Chess PuzzlesHill65.3 pp2
MMMU-Pro → DynaMathlinear75.3 pp11
VulcanBench Frontier v4 → PostTrainBench v1.1linear55.3 pp1
ERQA → MLVU (M-Avg)linear85.3 pp0
AA Agentic Index → CyberGymlinear105.3 pp46
WideResearch → HLE w/ toolslinear75.3 pp0
Harvey LAB-AA v1.1 → AA Cyber Indexoffset logistic65.3 pp4
ParseBench-2 → MMMU-ProMichaelis–Menten + offset55.3 pp6
AA-HLE → HLE w/o toolslinear365.4 pp25
Vals SWE-bench → CursorBench 3.2Michaelis–Menten175.4 pp9
WildGuardTest (Decision Index) → Decision Index Full Scoreinverse Michaelis–Menten115.4 pp2
CursorBench 3.2 → FrontierCode 2.0Hill65.4 pp5
Artificial Analysis Intelligence Index → MMLU-ProHill295.4 pp9
DAYJOB Healthcare → StealthMarkMichaelis–Menten + offset125.4 pp0
RealWorldQA → OCRBench V2inverse Michaelis–Menten65.4 pp6
Terminal-Bench Hard → Terminal-Bench 2.0Hill125.4 pp10
AA Terminal-Bench 4.0 → Terminal-Bench 2.1Hill55.4 pp18
OfficeQA Pro → ParseBench-1Hill95.4 pp3
GPQA Diamond → MMLU-ProMichaelis–Menten255.4 pp5
SEC-Bench Pro → SpireClimbHill65.4 pp6
WideResearch → BrowseCompoffset logistic115.4 pp0
MMLU-Redux → AA-Omniscience Accuracylinear55.4 pp4
Hermes Index → GDP.pdflinear65.4 pp0
ParseBench-2 → AA-MMMU-ProMichaelis–Menten145.4 pp4
Artificial Analysis Decision Index → When2Call (Decision Index)Hill145.5 pp5
Toolathlon-Verified → OSWorld 2.0offset logistic55.5 pp11
CursorBench 3.2 → Vals SWE-benchMichaelis–Menten175.5 pp0
RealWorldQA → We-MathHill65.5 pp3
EBR-bench → DAYJOB Healthcarelinear115.5 pp0
τ²-bench results → HLE w/ toolsHill85.5 pp27
ExploitGym → Hermes IndexMichaelis–Menten65.5 pp7
WideResearch → Toolathlon-Verifiedinverse Michaelis–Menten65.5 pp3
MMMU-Pro w/ Python → ParseBench-1linear65.5 pp2
Gert Labs → OSWorld-VerifiedHill165.5 pp19
AA Tau3 Banking → AA Agentic Indexinverse Michaelis–Menten155.5 pp2
Harvey LAB-AA v1.1 → AA-AnalystAgentoffset logistic65.5 pp2
Decision Index Full Score → Decision Index ArtsMichaelis–Menten + offset1105.5 pp0
HealthBench (length-adjusted) → HealthBench (raw)Hill85.5 pp0
MathVision → ERQAMichaelis–Menten125.5 pp2
ExploitGym → AA-AnalystAgentHill105.5 pp8
MirrorCode → DAYJOBlinear165.5 pp0
MMMLU → Artificial Analysis Intelligence Indexinverse Michaelis–Menten75.5 pp2
BabaIsBench → DAYJOBoffset logistic105.5 pp1
AA-LCR → LongBench v2Hill175.5 pp194
DeepsecBench-AA → AA AutomationBenchHill115.5 pp6
τ³-bench results → PinchBenchMichaelis–Menten + offset75.5 pp9
Bug Hunt Bench → VulcanBench Frontier v4offset logistic135.5 pp0
CWE-bench → OSWorld 2.1 OfflineMichaelis–Menten75.5 pp6
CWE-bench → GDP.pdfMichaelis–Menten145.5 pp1
Decision Index Arts → Decision Index Knowledgeinverse Michaelis–Menten1105.5 pp0
CyberGym → Gert Labslinear85.5 pp17
HLE w/o tools → CritPtlinear405.5 pp2
CWE-bench v1 → ExploitGyminverse Michaelis–Menten65.5 pp2
PostTrainBench v1.1 → ScarfBenchHill65.5 pp3
MCP Atlas → APEX-Agents-AAinverse Michaelis–Menten145.5 pp9
SWE-bench Verified → PostTrainBench v1Hill65.5 pp19
AA Terminal-Bench 2.1 → Terminal-Bench 2.1 (Vals AI)inverse Michaelis–Menten185.5 pp2
GDPval-AA → MazeBenchoffset logistic415.5 pp81
AA Coding Index → Vals SWE-benchMichaelis–Menten + offset495.5 pp37
BFCL v4 → GDPval-AAlinear95.5 pp13
DAYJOB → MaxxBenchMichaelis–Menten85.6 pp4
FrontierCode 1.1 Main → Vibe Code BenchMichaelis–Menten55.6 pp12
Terminal-Bench Hard → Terminal-Bench 2.1 (Vals AI)Hill135.6 pp9
DynaMath → ERQAHill65.6 pp0
ParseBench-1 → CharXivlinear125.6 pp20
HLE w/o tools → Artificial Analysis Intelligence Indexlinear345.6 pp21
Chess Puzzles → FACTS Multimodallinear205.6 pp28
ARC-AGI-1 → CritPtoffset logistic375.6 pp0
Toolathlon-Verified → GDPval-AAinverse Michaelis–Menten145.6 pp7
HMMT Feb 2026 → IMOAnswerBenchMichaelis–Menten + offset95.6 pp18
BrowseComp → HLE w/ toolsHill225.6 pp9
SWE-bench Pro → CursorBench 3.1Michaelis–Menten + offset55.6 pp36
Toolathlon → WideResearchlinear75.6 pp1
SciCode → SWE-bench VerifiedHill205.6 pp7
Decision Index Knowledge → Decision Index LanguageHill1105.6 pp0
Decision Index Retrieval → Decision Index Knowledgeinverse Michaelis–Menten1105.6 pp0
PostTrainBench v1.1 → CursorBench 3.2offset logistic85.6 pp0
Artificial Analysis Decision Index → Decision Index Languageinverse Michaelis–Menten115.6 pp5
EBR-bench → FrontierPhysicslinear155.6 pp0
CharXiv → ERQAMichaelis–Menten175.6 pp6
MMMU-Pro → CharXivinverse Michaelis–Menten305.6 pp11
Vals LiveCodeBench → VulcanBench v3offset logistic125.6 pp68
Terminal-Bench 4.1 → Terminal-Bench 2.1Michaelis–Menten + offset235.6 pp11
FACTS Multimodal → SEC-Bench Prooffset logistic85.6 pp13
ParseBench-1 → SWE-bench Multimodaloffset logistic55.6 pp31
Vals SWE-bench → AA Coding IndexHill495.6 pp12
AA-AnalystAgent → MKAMichaelis–Menten + offset125.6 pp6
BinaryAudit → OTelBenchHill115.6 pp6
ResearchClawBench → BrowseCompoffset logistic105.6 pp4
APEX-Agents → APEX-Agents-AAMichaelis–Menten55.7 pp0
SimpleVQA → Video-MME (with subtitle)Michaelis–Menten105.7 pp0
Artificial Analysis Decision Index v1.0 → Decision Index Knowledgeinverse Michaelis–Menten115.7 pp0
Decision Index Retrieval → Artificial Analysis Decision Index v1.0Michaelis–Menten115.7 pp5
HLE w/ tools → Toolathlon-VerifiedMichaelis–Menten + offset145.7 pp9
BrowseComp → OSWorld-VerifiedHill155.7 pp28
ScarfBench → DeepSWEMichaelis–Menten95.7 pp0
BioMysteryBench (human-solvable) → CritPtlinear55.7 pp0
StealthMark → MaxxBenchlinear95.7 pp23
ExtractBench Pro → ParseBench-1linear75.7 pp1
LiveCodeBench v6 → AA Coding IndexHill215.7 pp15
Artificial Analysis Intelligence Index → Vals GPQA DiamondHill725.7 pp8
VideoMMMU → DynaMathlinear75.7 pp0
AA-SciCode → Vals LiveCodeBenchMichaelis–Menten385.7 pp42
AA ITBench → BrowseCompHill105.7 pp1
MMLU-Pro → GPQAHill625.7 pp2
CountBench → We-Mathlinear65.7 pp0
CursorBench 4.0 → FrontierCode 1.1 MainMichaelis–Menten55.7 pp0
AA Harvey LAB v1.0 → HLE w/ toolsHill55.7 pp0
ProgramBench → AA-SciCodeoffset logistic155.7 pp0
BioBasicsBench → CritPtHill75.7 pp0
OpenHarmony Bench v1.0 → NL2Repolinear105.7 pp0
MazeBench → MKAlinear185.7 pp15
AA Coding Index → PostTrainBench v1.1Hill125.7 pp6
GPQA → AA-HLEinverse Michaelis–Menten915.7 pp29
GDP.pdf → MKAHill155.7 pp0
MMMU → DynaMathMichaelis–Menten + offset75.8 pp11
Vals SWE-bench → CursorBench 3.1linear75.8 pp14
Toolathlon-Verified → HLE w/ toolslinear145.8 pp1
Hermes Index → AA-AnalystAgentMichaelis–Menten95.8 pp1
Toolathlon → ApprenticeBenchHill55.8 pp0
AA ITBench → CyberGymMichaelis–Menten95.8 pp2
CyberGym → AA Agentic Indexinverse Michaelis–Menten105.8 pp10
Vals GPQA Diamond → Artificial Analysis Intelligence Indexinverse Michaelis–Menten725.8 pp10
CursorBench 4.0 → FrontierSWE v2linear155.8 pp0
DAYJOB → SEC-Bench ProMichaelis–Menten85.8 pp3
CritPt → AA-HLEHill2005.8 pp2
ApprenticeBench → MCP Atlaslinear55.8 pp11
CWE-bench v1 → CWE-benchMichaelis–Menten75.8 pp3
CountBench → V*inverse Michaelis–Menten65.8 pp3
Terminal-Bench 2.1 (Vals AI) → Terminal-Bench 2.0Michaelis–Menten195.8 pp43
FrontierCode 2.0 → VulcanBench Frontier v4linear145.8 pp2
HLE-Verified → AA-Omniscience AccuracyMichaelis–Menten + offset65.8 pp0
MLVU (M-Avg) → MMMU-ProHill105.8 pp0
AA Terminal-Bench 4.0 → Terminal-Bench 4.1linear195.8 pp3
Mystery Game Puzzles → FACTS Multimodallinear215.8 pp3
Gert Labs → WideResearchHill75.9 pp22
AA Coding Index → PostTrainBenchHill125.9 pp4
MMVU → CharXivinverse Michaelis–Menten65.9 pp0
VideoMMMU → CharXivHill105.9 pp0
Gert Labs → OSWorld 2.0linear55.9 pp22
Decision Index Full Score → Decision Index ToolsHill1105.9 pp0
Agents' Last Exam → CyberGymMichaelis–Menten95.9 pp1
Vals MMLU-Pro → CritPtinverse Michaelis–Menten705.9 pp0
MazeBench → AA-AnalystAgentHill225.9 pp13
SWE-bench Pro → SciCodeMichaelis–Menten205.9 pp3
τ³-bench results → AA Agentic Indexoffset logistic85.9 pp10
DAYJOB Healthcare → FrontierPhysicslinear125.9 pp0
HealthBench (length-adjusted) → AA-HLEMichaelis–Menten + offset85.9 pp0
FrontierCode 1.1 Main → PostTrainBench v1.1Hill65.9 pp0
Chartography (tools) → Chartography (no tools)inverse Michaelis–Menten76.0 pp3
AutomationBench → CWE-Bench-AAHill106.0 pp7
ARC-AGI-1 → AA-HLEoffset logistic366.0 pp2
DeepSWE → NL2Repolinear156.0 pp36
FrontierPhysics → StealthMarklinear206.0 pp6
CWE-Bench-AA → HLE w/ toolsMichaelis–Menten86.0 pp0
LiveCodeBench v6 → SWE-bench Prolinear226.0 pp15
GDPval-AA → QwenClawBenchoffset logistic66.0 pp76
JobBench → ApprenticeBenchHill76.0 pp19
Toolathlon-Verified → CyberGymHill76.0 pp3
CursorBench 3.2 → ProgramBenchHill56.0 pp9
Decision Index Knowledge → Decision Index ArtsMichaelis–Menten + offset1106.0 pp0
FrontierCode 2.0 → cursorBench41Michaelis–Menten106.0 pp8
AA-HLE → HealthBench (raw)Michaelis–Menten86.0 pp109
HLE → HLE w/o toolslinear366.0 pp4
GDPval-AA → OSWorld 2.1Michaelis–Menten96.0 pp27
PostTrainBench v1.1 → SWE-bench Prolinear106.0 pp0
SWE-bench Pro → LiveCodeBench ProMichaelis–Menten66.0 pp74
WideResearch → MCP-TasksHill56.0 pp5
GDPval-AA → CyberGymMichaelis–Menten186.0 pp46
Toolathlon-Verified → BrowseCompHill116.0 pp2
PostTrainBench → FrontierCode 2.0Hill156.0 pp4
MedXpertQA (MM) → ERQAinverse Michaelis–Menten76.0 pp0
ARC-AGI-2 → AA-HLEoffset logistic386.0 pp1
CyberGym → APEX-Agents-AAinverse Michaelis–Menten76.0 pp7
AA Tau3 Banking → MCP AtlasMichaelis–Menten + offset76.0 pp7
AA Coding Index → SWE-bench ProMichaelis–Menten386.0 pp22
ExploitBench → StealthMarkHill116.1 pp5
ProgramBench → Vals LiveCodeBenchoffset logistic66.1 pp5
CursorBench 4.0 → PostTrainBenchHill86.1 pp0
WideResearch → Gert LabsMichaelis–Menten76.1 pp5
AA Terminal-Bench 4.0 → Terminal-Bench 4.0Hill106.1 pp3
AA-SciCode → AA Coding Indexoffset logistic746.1 pp8
Toolathlon → AA ITBenchinverse Michaelis–Menten76.1 pp0
Chess Puzzles → FrontierPhysicslinear246.1 pp18
BioBasicsBench → HealthBench ProfessionalMichaelis–Menten56.1 pp0
HLE w/ tools → GDP.pdflinear66.1 pp11
MazeBench → OSWorld 2.1Michaelis–Menten + offset106.1 pp15
AA-GPQA Diamond → GPQAlinear886.1 pp57
AA AutomationBench → AutomationBenchoffset logistic66.1 pp16
NYT Connections → SkillsBench official leaderboard (BenchFlow)Michaelis–Menten196.1 pp31
HLE → CritPtlinear616.1 pp3
Chess Puzzles → DAYJOB HealthcareHill196.1 pp18
SWE-bench Pro → NL2Repolinear286.1 pp8
ParseBench-1 → AA-MMMU-Prooffset logistic296.1 pp3
ARC-AGI-2 → HLEHill196.1 pp10
Agents' Last Exam → MazeBenchHill126.2 pp1
SWE-bench Verified → NL2RepoHill196.2 pp25
Terminal-Bench 4.1 → AA Terminal-Bench 4.0linear196.2 pp31
Hermes Bench → CWE-benchlinear76.2 pp0
JobBench → BrowseComplinear126.2 pp12
SEC-Bench Pro → FrontierPhysicslinear116.2 pp0
GPQA → AA-GPQA Diamondlinear886.2 pp26
VideoMMMU → MathVisionMichaelis–Menten106.2 pp0
Video-MME (with subtitle) → Video-MME (w/o subtitle)Michaelis–Menten76.2 pp0
Vals LiveCodeBench → FrontierCode 1.1 MainHill96.2 pp8
AA-MMMU-Pro → ParseBench-2inverse Michaelis–Menten146.2 pp53
ARC-AGI-3 Provider Adapter → Artificial Analysis Intelligence Indexlinear136.2 pp0
JobBench → GDPval-AAlinear166.2 pp14
OSWorld 2.0 → MazeBenchMichaelis–Menten + offset186.2 pp0
Decision Index Arts → Decision Index Full Scorelinear1106.2 pp0
OSWorld-Verified → Claw-EvalMichaelis–Menten96.2 pp14
Chess Puzzles → SkillsBench official leaderboard (BenchFlow)Michaelis–Menten176.2 pp27
ScarfBench → PostTrainBench v1.1inverse Michaelis–Menten66.2 pp1
GraphWalks BFS 256K–1M → Artificial Analysis Intelligence Indexoffset logistic56.2 pp0
AA-MMMU-Pro → ParseBench-1Hill296.2 pp60
EBR-bench → FACTS MultimodalHill116.2 pp0
OSWorld 2.1 Offline → MazeBenchlinear116.2 pp0
Vals GPQA Diamond → AA-HLEoffset logistic746.2 pp8
AA-MMMU-Pro → CharXivMichaelis–Menten316.3 pp48
MazeBench → ExploitGymMichaelis–Menten + offset156.3 pp14
Vals MMLU-Pro → AA-GPQA Diamondlinear746.3 pp0
AA-HLE → Vals GPQA DiamondMichaelis–Menten746.3 pp0
APEX-Agents-AA → AA ITBenchoffset logistic96.3 pp3
MMLU-Redux → Artificial Analysis Intelligence IndexHill66.3 pp4
GDPval-AA → Toolathlonoffset logistic196.3 pp76
MMVU → MathVisioninverse Michaelis–Menten76.3 pp0
MCP Atlas → Claw-Evallinear196.3 pp20
Terminal-Bench 4.0 → AA Terminal-Bench 4.0linear106.3 pp12
FACTS Multimodal → NYT ConnectionsHill226.3 pp1
MaxxBench → DAYJOBlinear86.3 pp1
AA-SciCode → SWE-bench Verifiedlinear356.3 pp23
cursorBench41 → FrontierCode 2.0inverse Michaelis–Menten106.3 pp0
PerceptionBench → ZeroBenchHill56.3 pp0
MKA → AA-AnalystAgentlinear126.3 pp1
Chess Puzzles → DAYJOBHill196.3 pp17
Mystery Game Puzzles → SkillsBench official leaderboard (BenchFlow)linear146.3 pp6
AA-SciCode → SWE-bench Proinverse Michaelis–Menten436.3 pp16
Decision Index Language → Decision Index Artslinear1106.3 pp0
PostTrainBench v1.1 → Bug Hunt BenchHill76.3 pp8
ExploitBench Internal Port → StealthMarklinear66.3 pp0
We-Math → CharXivMichaelis–Menten56.3 pp0
APEX-Agents → HLE w/ toolsMichaelis–Menten66.3 pp1
OSWorld-Verified → ApprenticeBenchlinear76.3 pp10
MKA → GDPval-AAoffset logistic156.4 pp2
MMMLU → AA-GPQA Diamondlinear96.4 pp0
Terminal-Bench 2.0 → Terminal-Bench 2.1 (Vals AI)linear196.4 pp16
Artificial Analysis Decision Index v1.0 → Decision Index Full Scorelinear116.4 pp0
ResearchClawBench → AA Agentic Indexinverse Michaelis–Menten116.4 pp3
BlenderWorld (text-only) → NYT ConnectionsHill56.4 pp2
Claw-Eval → MCP-Tasksinverse Michaelis–Menten56.4 pp13
ApprenticeBench → GDPval-AAMichaelis–Menten166.4 pp0
GDPval-AA → MKAMichaelis–Menten156.4 pp31
BrowseComp → MazeBenchinverse Michaelis–Menten146.4 pp21
Hermes Index → ExploitGymHill66.4 pp2
BrowseComp → Claw-Evaloffset logistic156.4 pp18
AA Coding Index → DeepSWEHill206.4 pp16
BrowseComp → CWE-Bench-AAMichaelis–Menten86.4 pp26
MMMU-Pro → ERQAoffset logistic156.4 pp7
ExtractBench Pro → ParseBench-2linear56.4 pp1
ApprenticeBench → AA Agentic Indexlinear156.4 pp0
AA-AnalystAgent → MazeBenchoffset logistic226.4 pp1
GDPval-AA → CWE-bench v1Michaelis–Menten106.4 pp86
DRACO → Hermes BenchMichaelis–Menten56.4 pp1
DeepsecBench-AA → MazeBenchlinear176.4 pp0
ExploitBench Internal Port → Mystery Game PuzzlesMichaelis–Menten76.4 pp2
DeepSWE → CursorBench 3.2Hill106.4 pp8
V* → MLVU (M-Avg)offset logistic66.4 pp0
CharXiv → MedXpertQA (MM)linear66.4 pp16
AA Coding Index → SWE-bench VerifiedMichaelis–Menten346.5 pp11
Vals MMLU-Pro → AA-Omniscience Accuracyinverse Michaelis–Menten686.5 pp14
DAYJOB Healthcare → FACTS MultimodalHill156.5 pp0
HLE w/o tools → HLEMichaelis–Menten + offset366.5 pp16
ExploitBench → Furniture Assemblylinear96.5 pp7
ScreenSpot Pro → V*Hill56.5 pp17
FrontierMath (legacy) → FrontierMath v2 (Tiers 1-3)offset logistic76.5 pp0
Furniture Assembly → FACTS MultimodalHill186.5 pp0
WildGuardTest (Decision Index) → Decision Index KnowledgeHill116.5 pp0
Vals GPQA Diamond → ARC-AGI-1Hill286.5 pp30
React Native Evals → Vibe Code Benchoffset logistic76.5 pp9
Bug Hunt Bench → NL2RepoMichaelis–Menten56.5 pp6
DAYJOB → FACTS Multimodallinear156.5 pp0
Hermes Bench → GDPval-AAlinear136.5 pp0
SuperGPQA → MMLU-ProMichaelis–Menten186.5 pp2
VulcanBench Frontier v4 → DeepSWEHill156.5 pp2
HLE → AA-HLEMichaelis–Menten + offset596.5 pp3
Video-MME (with subtitle) → VideoMMMUinverse Michaelis–Menten116.5 pp0
CountBench → ERQAHill66.5 pp0
Furniture Assembly → ExploitBenchoffset logistic96.5 pp20
Terminal-Bench 4.0 → Terminal-Bench 2.1offset logistic106.5 pp6
AA-MMMU-Pro → MedXpertQA (MM)offset logistic66.5 pp45
HealthBench Professional (raw, Artificial Analysis) → HLE w/o toolsHill56.5 pp0
MMLU-ProX → MAXIFEinverse Michaelis–Menten56.5 pp5
Furniture Assembly → StealthMarkHill216.5 pp11
ApprenticeBench → τ²-bench resultsMichaelis–Menten86.5 pp6
Vals GPQA Diamond → HLE w/o toolsoffset logistic216.5 pp0
Vibe Code Bench → SWE-RebenchHill56.5 pp27
Hermes Bench → MazeBenchoffset logistic136.5 pp0
GPQA → HLEinverse Michaelis–Menten536.5 pp60
SEC-Bench Pro → ExploitBench Internal Portinverse Michaelis–Menten96.5 pp2
Artificial Analysis Decision Index v1.0 → Decision Index RetrievalMichaelis–Menten116.5 pp2
Gert Labs → BrowseComplinear156.6 pp15
AA-IFBench → IFBenchHill136.6 pp127
SWE-bench Verified → Vals SWE-benchlinear266.6 pp49
SEC-Bench Pro → StealthMarklinear116.6 pp0
Terminal-Bench 3.0 → Terminal-Bench 2.1linear116.6 pp0
AA LiveCodeBench → Vibe Code Benchoffset logistic76.6 pp3
Vals MMLU-Pro → Vals GPQA DiamondHill856.6 pp0
WildGuardTest (Decision Index) → Decision Index Retrievaloffset logistic116.6 pp0
MKA → MazeBenchlinear186.6 pp0
Finance Agent v2 → MazeBenchlinear66.6 pp1
WideResearch → OSWorld-VerifiedHill56.6 pp0
Agents' Last Exam → MKAMichaelis–Menten + offset86.6 pp1
DAYJOB → ExploitBench Internal Portinverse Michaelis–Menten56.6 pp0
AA MMLU-Pro → AA-HLElinear136.6 pp0
APEX-Agents → MCP Atlasoffset logistic66.6 pp6
Vals GPQA Diamond → MMLU-ProMichaelis–Menten106.6 pp0
C-Eval → AA-HLElinear76.6 pp0
Furniture Assembly → MaxxBenchlinear106.6 pp5
CharXiv w/o tools → MMMU-Proinverse Michaelis–Menten96.6 pp0
NYT Connections → OTelBenchoffset logistic86.6 pp60
ARC-AGI-2 → HLE w/o toolslinear186.6 pp0
OSWorld-Verified → Gert Labsinverse Michaelis–Menten166.6 pp11
SWE-Atlas Codebase QnA → DeepSWEMichaelis–Menten + offset86.6 pp0
Video-MME (w/o subtitle) → We-MathMichaelis–Menten66.6 pp0
AA-SciCode → FrontierCode 1.1 Mainoffset logistic116.6 pp12
PostTrainBench → ScarfBenchMichaelis–Menten76.6 pp0
SkillsBench → MCP AtlasMichaelis–Menten56.6 pp2
When2Call (Decision Index) → Decision Index RetrievalMichaelis–Menten116.7 pp0
ARC-AGI-3 → CritPtlinear216.7 pp0
SpireClimb → FACTS MultimodalHill76.7 pp0
SWE-bench Pro → FrontierCode 2.0Hill86.7 pp62
BrowseComp → VITA-BenchHill66.7 pp57
MCP Atlas → WideResearchoffset logistic136.7 pp4
Bug Hunt Bench → FrontierCode 2.0linear216.7 pp2
FACTS Multimodal → DAYJOB Healthcarelinear156.7 pp0
Decision Index Tools → Decision Index Artslinear1106.7 pp0
AA Agentic Index → HLE w/ toolslinear106.7 pp0
CWE-bench → MazeBenchlinear176.7 pp0
AA Tau3 Banking → GDPval-AAMichaelis–Menten176.7 pp1
SimpleVQA → We-Mathlinear66.7 pp2
MMLU-Pro → AA-HLEoffset logistic506.7 pp1
APEX-Agents-AA → Toolathlonlinear156.7 pp3
SuperGPQA → AA-Omniscience AccuracyMichaelis–Menten126.7 pp7
AutomationBench → BrowseCompMichaelis–Menten106.7 pp3
HealthBench Professional → BioBasicsBenchoffset logistic56.7 pp1
GPQA → ARC-AGI-1linear196.7 pp31
MMLU-Pro → AA-GPQA DiamondHill506.7 pp0
ScreenSpot Pro → ZeroBenchHill56.7 pp5
Terminal-Bench 2.1 (Vals AI) → Terminal-Bench 2.1Hill316.7 pp25
BrowseComp → DeepSearchQAHill166.8 pp30
AA ITBench → MCP AtlasMichaelis–Menten96.8 pp8
AA-SciCode → VulcanBench Frontier v4Michaelis–Menten186.8 pp50
Gert Labs → AA Agentic Indexinverse Michaelis–Menten196.8 pp19
Gert Labs → Claw-EvalMichaelis–Menten226.8 pp14
GDP.pdf → HLE w/ toolslinear66.8 pp6
StealthMark → ExploitBench Internal Portinverse Michaelis–Menten66.8 pp11
AA-HLE → HLE-Verifiedoffset logistic66.8 pp24
MaxxBench → FrontierPhysicsHill96.8 pp0
AA-MMMU-Pro → OfficeQA Prooffset logistic96.8 pp67
ARC-AGI-3 Provider Adapter → ARC-AGI-3Hill136.8 pp0
FrontierCode 1.1 Main → VulcanBench Frontier v4offset logistic56.8 pp0
Bug Hunt Bench → cursorBench41linear126.8 pp0
GPQA Diamond → HLEoffset logistic426.8 pp14
CharXiv → ScreenSpot ProHill146.8 pp25
CritPt → BioMysteryBench (human-difficult)Michaelis–Menten66.8 pp201
When2Call (Decision Index) → Decision Index KnowledgeHill116.8 pp0
DeepSearchQA → BrowseCompoffset logistic166.8 pp1
MMLU-Redux → HLElinear96.8 pp0
CountBench → Video-MME (with subtitle)Hill76.8 pp0
FrontierCode 1.1 Main → SWE-bench ProHill96.8 pp3
CWE-Bench-AA → GDP.pdfoffset logistic116.8 pp0
OSWorld 2.0 → AA Agentic IndexHill166.8 pp0
ResearchClawBench → OSWorld 2.0inverse Michaelis–Menten56.9 pp3
HLE-MultiChoice (Decision Index) → Decision Index Full Scoreoffset logistic116.9 pp0
MMLU-Pro → Vals MMLU-ProMichaelis–Menten96.9 pp1
Vibe Code Bench → AA Coding Indexlinear166.9 pp8
FrontierPhysics → SEC-Bench Prolinear116.9 pp5
OmniDocBench 1.5 → We-MathHill56.9 pp0
SpireClimb → SEC-Bench Prooffset logistic66.9 pp1
Terminal-Bench 2.1 (Vals AI) → Terminal-Bench 3.0Hill116.9 pp24
Bug Hunt Bench → DeepSWEMichaelis–Menten246.9 pp1
DynaMath → MMMU-Prooffset logistic76.9 pp0
DeepsecBench-AA → GDPval-AAMichaelis–Menten + offset186.9 pp1
ResearchClawBench → Toolathlonoffset logistic96.9 pp3
CursorBench 3.1 → SWE-bench ProMichaelis–Menten + offset56.9 pp0
ParseBench-1 → MMMU-Prolinear156.9 pp5
MMLU → AA-GPQA Diamondoffset logistic246.9 pp2
HLE-MultiChoice (Decision Index) → When2Call (Decision Index)Hill196.9 pp0
OfficeQA → SWE-bench Multimodalinverse Michaelis–Menten56.9 pp0
CWE-bench v1 → MazeBenchHill106.9 pp0
Decision Index Tools → When2Call (Decision Index)linear116.9 pp2
AA Terminal-Bench 4.0 → Terminal-Bench 2.1 (Vals AI)linear76.9 pp15
Decision Index Retrieval → Decision Index Full Scoreoffset logistic1106.9 pp0
Terminal-Bench-Science 0.1 → Terminal-Bench 4.0Michaelis–Menten116.9 pp0
ARC-AGI-1 → HLEoffset logistic167.0 pp1
SpireClimb → DAYJOBMichaelis–Menten67.0 pp0
CritPt → Vals GPQA DiamondHill707.0 pp1
AA-GPQA Diamond → MMLU-ProHill507.0 pp16
SimpleVQA → ERQAlinear127.0 pp0
Hermes Bench → CWE-bench v1Hill57.0 pp0
Agents' Last Exam → GDP.pdfMichaelis–Menten + offset57.0 pp0
When2Call (Decision Index) → Decision Index Full ScoreMichaelis–Menten117.0 pp0
FrontierPhysics → MaxxBenchlinear97.0 pp2
BabyVision w/ Python → ZeroBench w/ PythonHill57.0 pp4
APEX-Agents-AA → τ²-bench resultsMichaelis–Menten217.0 pp5
ExploitBench Internal Port → ExploitBenchMichaelis–Menten77.0 pp0
Artificial Analysis Decision Index v1.0 → Decision Index Languagelinear117.0 pp0
MLVU (M-Avg) → We-MathMichaelis–Menten67.0 pp0
MLVU (M-Avg) → VideoMMMUinverse Michaelis–Menten107.0 pp0
React Native Evals → Vals SWE-benchinverse Michaelis–Menten77.0 pp3
Agents' Last Exam → Hermes IndexHill77.0 pp3
WildGuardTest (Decision Index) → Decision Index Artsoffset logistic117.0 pp0
ParseBench-1 → OfficeQA ProMichaelis–Menten97.0 pp6
Toolathlon → MCP-TasksMichaelis–Menten57.0 pp9
DAYJOB → Furniture AssemblyMichaelis–Menten + offset167.1 pp3
VITA-Bench → Claw-EvalHill77.1 pp0
HLE → AA-GPQA DiamondHill517.1 pp3
HealthBench Hard → CritPtHill127.1 pp0
AA Coding Index → Vals LiveCodeBenchMichaelis–Menten497.1 pp9
ARC-AGI-1 → HLE w/o toolsHill147.1 pp0
HLE w/ tools → BrowseCompMichaelis–Menten227.1 pp1
AA Tau3 Banking → AutomationBenchinverse Michaelis–Menten77.1 pp10
MATH-500 → AIME 2024offset logistic157.1 pp4
Vibe Code Bench → Vals SWE-benchMichaelis–Menten + offset297.1 pp8
CharXiv w/o tools → ZeroBenchHill57.1 pp7
Decision Index Retrieval → Decision Index Artslinear1107.1 pp0
AA-Omniscience Accuracy → HLE-Verifiedinverse Michaelis–Menten67.1 pp48
FrontierPhysics → FACTS Multimodallinear157.1 pp1
SimpleVQA → MedXpertQA (MM)offset logistic67.1 pp1
DeepSearchQA → OSWorld-VerifiedMichaelis–Menten77.1 pp2
OmniDocBench 1.5 → SimpleVQAHill87.1 pp2
MMMU → SimpleVQAinverse Michaelis–Menten97.1 pp0
HealthBench Professional (raw, Artificial Analysis) → PhysicianBenchHill57.1 pp0
BrowseComp → Gert Labsinverse Michaelis–Menten157.1 pp29
ProgramBench → PostTrainBench v1.1Michaelis–Menten + offset57.2 pp0
Gert Labs → ToolathlonMichaelis–Menten + offset137.2 pp16
MMMU → We-MathMichaelis–Menten + offset67.2 pp16
Mystery Game Puzzles → ExploitBenchMichaelis–Menten + offset107.2 pp33
BioBasicsBench → AA-Omniscience AccuracyMichaelis–Menten77.2 pp0
SimpleVQA → MathVisionMichaelis–Menten97.2 pp0
MaxxBench → DAYJOB Healthcarelinear87.2 pp0
Vals LiveCodeBench → CursorBench 3.2offset logistic167.2 pp18
HLE w/ tools → OSWorld 2.1Michaelis–Menten + offset87.2 pp11
Toolathlon → Gert LabsHill137.2 pp1
Furniture Assembly → ExploitBench Internal PortHill77.2 pp0
ScreenSpot Pro → Video-MME (with subtitle)linear67.2 pp4
NL2Repo → Bug Hunt Benchinverse Michaelis–Menten57.2 pp28
Decision Index Tools → Decision Index Languagelinear1107.2 pp0
AA-GPQA Diamond → BioBasicsBenchinverse Michaelis–Menten57.2 pp0
Vals SWE-bench → DeepSWEoffset logistic187.2 pp27
Hermes Bench → Hermes Indexinverse Michaelis–Menten167.2 pp0
CritPt → Artificial Analysis Intelligence IndexMichaelis–Menten + offset1547.2 pp31
HLE → SuperGPQAlinear137.2 pp63
SWE-bench Pro → Vals SWE-benchHill387.2 pp3
HLE w/o tools → ARC-AGI-3Hill117.2 pp45
CyberGym-E2E-AA → AA EnterpriseOps-Gymlinear67.2 pp13
MKA → ExploitGymlinear87.2 pp2
Decision Index Arts → Decision Index LanguageMichaelis–Menten1107.2 pp0
HLE-Verified → Vals GPQA Diamondlinear67.2 pp0
HLE-MultiChoice (Decision Index) → Decision Index RetrievalMichaelis–Menten117.2 pp0
NYT Connections → SpireClimboffset logistic107.2 pp57
OpenHarmony Bench v1.0 → Vals SWE-benchlinear117.3 pp0
VulcanBench Frontier v4 → cursorBench41inverse Michaelis–Menten67.3 pp0
AA-HLE → ARC-AGI-3 Provider Adapteroffset logistic107.3 pp193
BrowseComp → CyberGyminverse Michaelis–Menten157.3 pp20
OSWorld 2.0 → HLE w/ toolsMichaelis–Menten57.3 pp0
AA-Omniscience Accuracy → CritPtinverse Michaelis–Menten1597.3 pp0
MCP Atlas → DeepSearchQAoffset logistic147.3 pp8
Terminal-Bench 2.1 → Terminal-Bench 2.1 (Vals AI)linear317.3 pp52
FACTS Multimodal → ExploitBenchHill67.3 pp2
Toolathlon → JobBenchMichaelis–Menten57.3 pp9
MathVision → SimpleVQAlinear97.3 pp11
Decision Index Full Score → Decision Index RetrievalMichaelis–Menten1107.3 pp0
Artificial Analysis Intelligence Index → AA-Omniscience AccuracyMichaelis–Menten + offset1637.3 pp12
ERQA → MathVisionMichaelis–Menten127.3 pp0
CritPt → HealthBench Professional (length-adjusted, Artificial Analysis)Michaelis–Menten + offset67.3 pp8
BrowseComp → Toolathlon-Verifiedlinear117.4 pp10
HLE-MultiChoice (Decision Index) → Decision Index LanguageMichaelis–Menten117.4 pp0
MKA → OSWorld 2.1 OfflineMichaelis–Menten97.4 pp1
HealthBench (raw, Artificial Analysis) → PhysicianBenchinverse Michaelis–Menten57.4 pp1
MMLU-Redux → GPQA Diamondlinear97.4 pp0
FACTS Multimodal → DAYJOBlinear157.4 pp0
AA-SciCode → NL2Repolinear167.4 pp11
APEX-Agents → AutomationBenchMichaelis–Menten67.4 pp5
AutomationBench → APEX-Agentsoffset logistic67.4 pp26
IFBench → AA-IFBenchoffset logistic137.4 pp44
Vals GPQA Diamond → AA-Omniscience AccuracyHill687.4 pp0
MMMU-Pro → We-MathMichaelis–Menten + offset67.4 pp23
ExploitGym → GDP.pdfMichaelis–Menten67.4 pp5
HealthBench Professional (raw, Artificial Analysis) → AA-HLEHill67.4 pp0
ARC-AGI-2 → AA-Omniscience AccuracyHill407.4 pp4
EBR-bench → Furniture AssemblyMichaelis–Menten + offset277.4 pp5
MMLU-Redux → GPQAlinear167.4 pp0
JobBench → ToolathlonHill57.4 pp4
ARC-AGI-3 → AA-HLElinear227.4 pp0
GPQA → Artificial Analysis Intelligence Indexoffset logistic777.4 pp25
AA-HLE → Artificial Analysis Intelligence Indexoffset logistic1677.4 pp1
CharXiv w/o tools → BabyVisioninverse Michaelis–Menten57.4 pp9
AA-SciCode → PostTrainBench v1.1Hill137.4 pp18
ARC-AGI-3 Provider Adapter → AA-HLElinear107.4 pp0
Toolathlon-Verified → MCP AtlasMichaelis–Menten127.5 pp4
V* → ScreenSpot ProMichaelis–Menten + offset57.5 pp1
ExploitBench → Mystery Game Puzzlesinverse Michaelis–Menten107.5 pp6
APEX-Agents → GDPval-AAlinear77.5 pp1
Decision Index Knowledge → Decision Index ToolsHill1107.5 pp0
Video-MME (w/o subtitle) → SimpleVQAinverse Michaelis–Menten77.5 pp0
EBR-bench → SEC-Bench ProMichaelis–Menten + offset97.5 pp13
AA-SciCode → DeepSWEHill407.5 pp33
AA AutomationBench → DeepsecBench-AAlinear117.5 pp12
SWE-bench Pro → AA Coding IndexHill387.5 pp2
ApprenticeBench → DeepSearchQAlinear57.5 pp1
MMMU-Pro → SimpleVQAHill167.5 pp25
AA AutomationBench → HLE w/ toolslinear67.5 pp0
AA-Omniscience Accuracy → HLE w/o toolsMichaelis–Menten377.5 pp0
AA-MMMU-Pro → V*inverse Michaelis–Menten107.5 pp63
MazeBench → HLE w/ toolsoffset logistic157.5 pp3
MCP Atlas → ToolathlonHill177.5 pp4
MKA → DeepsecBench-AAMichaelis–Menten117.5 pp2
FACTS Multimodal → ExploitBench Internal Portlinear67.6 pp0
Decision Index Tools → Decision Index Retrievallinear1107.6 pp0
ARC-AGI-3 → AA-Omniscience Accuracylinear247.6 pp0
MMLU → GPQAoffset logistic267.6 pp2
SuperGPQA → AA-HLEoffset logistic177.6 pp2
ScreenSpot Pro → MLVU (M-Avg)linear67.6 pp5
ExploitGym → GDPval-AAMichaelis–Menten + offset177.6 pp4
DeepSWE → SciCodeMichaelis–Menten + offset57.6 pp14
Toolathlon → APEX-Agents-AAHill157.6 pp0
ARC-AGI-1 → HealthBench (raw)offset logistic67.6 pp4
DRACO → MCP AtlasMichaelis–Menten67.6 pp1
OCRBench V2 → MMMU-Proinverse Michaelis–Menten87.6 pp1
HLE w/ tools → GDPval-AAHill197.7 pp5
CritPt → HLE w/o toolsHill407.7 pp1
MaxxBench → StealthMarkinverse Michaelis–Menten97.7 pp3
AA Harvey LAB v1.0 → BrowseCompinverse Michaelis–Menten57.7 pp0
FailureSensorIQ → OTelBenchoffset logistic57.7 pp7
FrontierSWE v2 → Bug Hunt Benchoffset logistic207.7 pp4
DeepSWE → SWE-bench Prooffset logistic257.7 pp8
OSWorld 2.0 → GDPval-AAMichaelis–Menten227.7 pp0
HLE w/o tools → AA-Omniscience AccuracyHill377.7 pp14
PostTrainBench v1.1 → FrontierCode 2.0inverse Michaelis–Menten97.7 pp1
When2Call (Decision Index) → Decision Index LanguageMichaelis–Menten117.7 pp0
AA-GPQA Diamond → AA-Omniscience Accuracyoffset logistic1367.7 pp27
MMAnswerBench → FrontierMath v2 (Tiers 1-3)linear77.8 pp3
CritPt → ARC-AGI-1linear377.8 pp88
PostTrainBench → CursorBench 4.0Hill87.8 pp0
MCP Atlas → BrowseCompHill357.8 pp2
Artificial Analysis Intelligence Index → GPQAHill777.8 pp8
AA-Omniscience Accuracy → BioMysteryBench (human-difficult)Michaelis–Menten67.8 pp11
AA Agentic Index → MCP Atlasoffset logistic237.8 pp30
MCP Atlas → Gert Labslinear147.8 pp6
MaxxBench → FACTS MultimodalMichaelis–Menten77.8 pp0
GDPval-AA → WideResearchMichaelis–Menten67.8 pp54
EBR-bench → SkillsBench official leaderboard (BenchFlow)linear107.8 pp0
BrowseComp → GDPval-AAHill347.8 pp10
AA-GPQA Diamond → HLE w/o toolslinear257.8 pp0
AA-GPQA Diamond → SimpleQAlinear97.8 pp78
OSWorld-Verified → APEX-Agents-AAoffset logistic97.8 pp7
OSWorld 2.0 → CyberGymMichaelis–Menten87.9 pp0
DeepsecBench-AA → CWE-Bench-AAMichaelis–Menten197.9 pp0
HLE w/ tools → AA AutomationBenchoffset logistic67.9 pp25
AA-Omniscience Accuracy → ARC-AGI-1Michaelis–Menten397.9 pp4
AA EnterpriseOps-Gym → DeepSearchQAinverse Michaelis–Menten57.9 pp1
CyberGym-E2E-AA → AA Cyber IndexHill217.9 pp0
MazeBench → CWE-benchlinear177.9 pp18
MMMU → ScreenSpot Prooffset logistic77.9 pp16
EBR-bench → ExploitBenchMichaelis–Menten67.9 pp0
ScarfBench → AA-SciCodeHill107.9 pp0
AA-AnalystAgent → OSWorld 2.1 Offlineinverse Michaelis–Menten67.9 pp3
MCP Atlas → JobBenchinverse Michaelis–Menten137.9 pp21
CharXiv → We-Mathoffset logistic57.9 pp13
MirrorCode → FrontierPhysicsMichaelis–Menten217.9 pp0
Artificial Analysis Intelligence Index → ARC-AGI-1linear397.9 pp14
ScreenSpot Pro → AA-MMMU-Prolinear137.9 pp4
CursorBench 4.0 → Bug Hunt BenchHill177.9 pp4
OSWorld-Verified → DeepSearchQAHill77.9 pp9
Vals LiveCodeBench → NL2Repooffset logistic137.9 pp9
ARC-AGI-3 → Artificial Analysis Intelligence Indexlinear248.0 pp0
OSWorld-Verified → AA Agentic Indexinverse Michaelis–Menten178.0 pp4
FrontierCode 2.0 → FrontierSWE v2Michaelis–Menten158.0 pp15
AA Harvey LAB v1.0 → AA Agentic IndexHill78.0 pp0
Toolathlon-Verified → AA-AnalystAgentHill68.0 pp1
MMMU → OCRBench V2Michaelis–Menten58.0 pp11
VITA-Bench → BrowseComplinear68.0 pp0
ExploitGym → AA Agentic Indexlinear78.0 pp5
ExploitBench → Chess PuzzlesHill98.0 pp6
Cookie-Bench → Chess Puzzleslinear58.0 pp2
Video-MME (with subtitle) → MMMUMichaelis–Menten88.0 pp0
ResearchClawBench → GDPval-AAMichaelis–Menten148.0 pp3
AA-GPQA Diamond → Artificial Analysis Intelligence Indexoffset logistic1478.0 pp0
ARC-AGI-1 → AA-Omniscience AccuracyHill398.0 pp0
SEC-Bench Pro → ExploitBenchlinear98.0 pp0
AA-HLE → ARC-AGI-1linear368.1 pp2
Vals MMLU-Pro → Artificial Analysis Intelligence Indexoffset logistic728.1 pp0
ScarfBench → Vals SWE-benchlinear58.1 pp0
SimpleVQA → Video-MME (w/o subtitle)Michaelis–Menten78.1 pp0
VulcanBench Frontier v4 → SWE-bench Prooffset logistic98.1 pp1
AA-HLE → BioMysteryBench (human-difficult)Michaelis–Menten68.1 pp3
RoboDojo Sim → AutomationBenchMichaelis–Menten58.1 pp0
BrowseComp → AA Agentic Indexinverse Michaelis–Menten218.2 pp11
QwenClawBench → VITA-BenchMichaelis–Menten68.2 pp2
APEX-Agents-AA → JobBenchlinear58.2 pp11
JobBench → DeepSearchQAlinear98.2 pp13
ExploitGym → CWE-benchMichaelis–Menten78.2 pp6
AA-Omniscience Accuracy → Artificial Analysis Intelligence Indexlinear1638.2 pp0
CharXiv w/o tools → LVBenchHill68.2 pp12
AA-SciCode → Vals SWE-benchlinear428.2 pp15
MMLU → Vals GPQA DiamondHill88.2 pp3
ExploitBench → SpireClimblinear58.2 pp3
Decision Index Full Score → When2Call (Decision Index)Michaelis–Menten118.2 pp4
CWE-Bench-AA → AA AutomationBenchoffset logistic118.2 pp1
Terminal-Bench 4.1 → Terminal-Bench 2.1 (Vals AI)Michaelis–Menten + offset328.3 pp3
cursorBench41 → FrontierSWE v2linear128.3 pp0
HLE → ARC-AGI-3linear88.3 pp21
SWE-bench Pro → VulcanBench Frontier v4Michaelis–Menten98.3 pp29
ARC-AGI-2 → Artificial Analysis Intelligence Indexoffset logistic408.3 pp1
ERQA → MMMU-ProMichaelis–Menten + offset158.3 pp0
APEX-Agents → Toolathlon-Verifiedoffset logistic58.3 pp2
Artificial Analysis Intelligence Index → BioMysteryBench (human-difficult)Michaelis–Menten68.3 pp16
SpireClimb → Chess PuzzlesMichaelis–Menten + offset118.3 pp0
AA Agentic Index → ToolathlonHill158.3 pp0
AA Agentic Index → Gert Labslinear198.3 pp18
SWE-bench Pro → FrontierSWE v2linear98.3 pp68
HealthBench Professional → Artificial Analysis Intelligence Indexoffset logistic198.3 pp1
Chartography (no tools) → SWE-bench Multimodaloffset logistic58.3 pp6
AA-GPQA Diamond → MMLUHill248.3 pp17
OmniDocBench 1.5 → ERQAHill78.3 pp0
Decision Index Knowledge → Decision Index RetrievalMichaelis–Menten + offset1108.3 pp0
Vibe Code Bench → PostTrainBenchHill58.3 pp10
τ³-bench results → DeepPlanningoffset logistic68.3 pp7
Decision Index Arts → Decision Index RetrievalMichaelis–Menten + offset1108.4 pp0
JobBench → Gert LabsHill158.4 pp7
MMMU-Pro → ParseBench-1Hill158.4 pp14
GDPval-AA → OSWorld-Verifiedlinear218.4 pp58
SpireClimb → DAYJOB HealthcareMichaelis–Menten + offset68.4 pp0
GPQA Diamond → AA-Omniscience Accuracyinverse Michaelis–Menten468.4 pp16
Decision Index Language → Decision Index ToolsMichaelis–Menten + offset1108.4 pp0
CursorBench 3.2 → DeepSWEMichaelis–Menten108.4 pp0
Vals MMLU-Pro → ARC-AGI-1linear288.4 pp3
SciCode → DeepSWEinverse Michaelis–Menten58.4 pp12
Video-MME (with subtitle) → ScreenSpot Prooffset logistic68.4 pp1
MMLU-Pro (Arcee) → GPQA DiamondMichaelis–Menten68.4 pp0
FrontierCode 2.0 → SWE-bench Prolinear88.4 pp0
JobBench → OSWorld-VerifiedHill158.4 pp4
SWE-bench Verified → Vibe Code Benchoffset logistic118.4 pp88
DAYJOB Healthcare → MaxxBenchlinear88.4 pp0
ARC-AGI-3 Provider Adapter → AA-Omniscience AccuracyMichaelis–Menten + offset138.4 pp0
WildGuardTest (Decision Index) → When2Call (Decision Index)offset logistic198.4 pp0
τ²-bench results → BFCL v4Michaelis–Menten78.5 pp58
V* → ERQAMichaelis–Menten68.5 pp0
AA-HLE → HLEoffset logistic598.5 pp83
GDPval-AA → Gert Labslinear258.5 pp38
V* → We-Mathlinear58.5 pp0
HLE-Verified → Vals MMLU-Prolinear68.5 pp0
SkillsBench official leaderboard (BenchFlow) → OTelBenchHill58.5 pp0
FACTS Multimodal → FrontierPhysicsHill158.5 pp0
OSWorld-Verified → GDPval-AAoffset logistic218.5 pp4
SEC-Bench Pro → Furniture AssemblyHill118.5 pp0
GPQA → AA-Omniscience Accuracyoffset logistic728.5 pp15
GPQA → SuperGPQAHill168.5 pp54
Decision Index Retrieval → When2Call (Decision Index)Michaelis–Menten + offset118.5 pp12
SpireClimb → NYT Connectionslinear108.5 pp2
DeepPlanning → VITA-BenchHill58.5 pp0
ResearchClawBench → Gert LabsMichaelis–Menten + offset168.5 pp1
Hermes Index → DeepsecBench-AAoffset logistic108.6 pp1
CritPt → HealthBench HardMichaelis–Menten128.6 pp164
Hermes Index → GDPval-AAMichaelis–Menten138.6 pp0
DAYJOB Healthcare → Furniture AssemblyMichaelis–Menten + offset168.6 pp0
ExploitBench Internal Port → EBR-benchlinear68.6 pp3
GDP.pdf → GDPval-AAlinear138.6 pp1
MMLU-Redux → AA-GPQA DiamondHill98.6 pp0
React Native Evals → AA-SciCodeMichaelis–Menten + offset68.6 pp3
CharXiv → ParseBench-1inverse Michaelis–Menten128.6 pp7
AA Terminal-Bench 2.1 → Terminal-Bench 3.0Hill98.6 pp2
Toolathlon → CyberGymoffset logistic108.6 pp0
VulcanBench v3 → Bug Hunt BenchHill78.6 pp1
Hermes Bench → DeepsecBench-AAoffset logistic108.6 pp0
CyberGym → JobBenchMichaelis–Menten128.6 pp8
Vals MMLU-Pro → ARC-AGI-3linear138.6 pp33
BioBasicsBench → Artificial Analysis Intelligence IndexMichaelis–Menten78.6 pp0
AA-GPQA Diamond → ARC-AGI-1Hill288.6 pp0
JobBench → MCP AtlasMichaelis–Menten138.6 pp15
GPQA Diamond → ARC-AGI-3inverse Michaelis–Menten148.6 pp13
GDPval-AA → JobBenchlinear168.7 pp67
MirrorCode → StealthMarklinear248.7 pp2
AI2D_TEST → AA-MMMU-ProHill68.7 pp0
GDPval-AA → Hermes IndexMichaelis–Menten + offset138.7 pp81
EBR-bench → Mystery Game Puzzleslinear328.7 pp0
VideoMMMU → We-MathMichaelis–Menten + offset68.7 pp0
NL2Repo → DeepSWEinverse Michaelis–Menten158.7 pp9
VideoMMMU → SimpleVQAMichaelis–Menten118.7 pp0
ScreenSpot Pro → MMMU-ProMichaelis–Menten + offset158.7 pp4
ScreenSpot Pro → ERQAMichaelis–Menten108.7 pp4
IFEval → AA-IFBenchinverse Michaelis–Menten318.8 pp22
VulcanBench Frontier v4 → FrontierCode 2.0linear148.8 pp1
GDP.pdf → CWE-benchMichaelis–Menten + offset148.8 pp1
HealthBench Professional (length-adjusted, Artificial Analysis) → Artificial Analysis Intelligence Indexlinear68.8 pp0
Mystery Game Puzzles → MaxxBenchHill138.8 pp20
AIME26 → FrontierMath v2 (Tiers 1-3)linear98.8 pp16
MCP Atlas → Toolathlon-Verifiedlinear128.8 pp2
OfficeQA Pro → SWE-bench MultimodalHill68.8 pp4
Gert Labs → GDPval-AAlinear258.8 pp9
OTelBench → BinaryAuditoffset logistic118.8 pp2
DeepsecBench-AA → CWE-benchlinear98.9 pp0
ExploitBench Internal Port → SEC-Bench ProMichaelis–Menten + offset98.9 pp0
SEC-Bench Pro → NYT Connectionsinverse Michaelis–Menten108.9 pp4
FrontierCode 2.0 → Bug Hunt BenchMichaelis–Menten218.9 pp7
We-Math → Video-MME (w/o subtitle)Michaelis–Menten + offset68.9 pp0
GDPval-AA → DeepsecBench-AAHill188.9 pp101
MMMLU → MMLU-ProMichaelis–Menten58.9 pp0
IMOAnswerBench → HMMT Feb 2026linear98.9 pp1
AA Coding Index → SWE-Rebenchoffset logistic58.9 pp14
AA Cyber Index → HLE w/ toolsMichaelis–Menten88.9 pp0
EBR-bench → StealthMarklinear128.9 pp3
AA ITBench → AA Agentic IndexHill178.9 pp0
FailureSensorIQ → BinaryAuditlinear58.9 pp12
HLE w/o tools → MedXpertQA (Text)Michaelis–Menten58.9 pp17
FrontierCode 1.1 Extended → SWE-bench Prolinear69.0 pp0
ARC-AGI-1 → Artificial Analysis Intelligence IndexHill399.0 pp0
CWE-Bench-AA → GDPval-AAlinear189.0 pp0
AA-Omniscience Accuracy → Vals GPQA DiamondHill689.0 pp0
RealWorldQA → MMMUlinear129.0 pp2
AA LiveCodeBench → Vals SWE-benchHill99.0 pp2
C-Eval → AA-GPQA DiamondHill79.0 pp0
BrowseComp → DeepsecBench-AAHill89.0 pp19
FrontierCode 1.1 Main → CursorBench 4.0inverse Michaelis–Menten59.0 pp0
AA Agentic Index → BrowseCompMichaelis–Menten219.0 pp14
AA Coding Index → Bug Hunt BenchHill109.0 pp15
AA ITBench → OSWorld-VerifiedMichaelis–Menten + offset59.0 pp1
HMMT Feb 2026 → FrontierMath v2 (Tiers 1-3)Hill119.0 pp2
FrontierPhysics → Furniture AssemblyMichaelis–Menten + offset249.0 pp1
AA AutomationBench → CWE-Bench-AAHill119.0 pp3
MathVision → VideoMMMUinverse Michaelis–Menten109.0 pp0
MLVU (M-Avg) → ERQAHill89.0 pp0
AA Agentic Index → Hermes IndexMichaelis–Menten + offset59.0 pp0
GDP.pdf → DeepsecBench-AAMichaelis–Menten + offset119.1 pp0
SkillsBench official leaderboard (BenchFlow) → EBR-benchlinear109.1 pp6
VITA-Bench → DeepPlanningoffset logistic59.1 pp8
Decision Index Retrieval → Decision Index Toolslinear1109.1 pp0
Claw-Eval → Gert LabsMichaelis–Menten + offset229.1 pp6
MCP Atlas → SkillsBenchMichaelis–Menten59.1 pp13
HLE → AA-Omniscience Accuracyoffset logistic549.1 pp4
Bug Hunt Bench → SWE-bench Prolinear89.1 pp0
MMMU-Pro → BabyVisionHill69.1 pp26
RealWorldQA → MathVisionHill119.1 pp1
AA Coding Index → ScarfBenchoffset logistic69.1 pp69
MMLU-Pro → Artificial Analysis Intelligence IndexHill299.1 pp0
Terminal-Bench 2.1 → Terminal-Bench 3.0inverse Michaelis–Menten119.1 pp43
AA Agentic Index → OSWorld-Verifiedlinear179.1 pp0
AA ITBench → Gert LabsHill89.1 pp1
APEX-Agents-AA → MCP AtlasMichaelis–Menten + offset149.1 pp3
AA-HLE → AA-Omniscience Accuracyoffset logistic1599.1 pp0
τ³-bench results → AutomationBenchMichaelis–Menten59.1 pp26
HLE w/ tools → AA Agentic Indexinverse Michaelis–Menten109.2 pp2
GDPval-AA → BrowseCompMichaelis–Menten349.2 pp28
AA-HLE → AA-GPQA DiamondHill1909.2 pp3
IFEval → IFBenchHill229.2 pp22
BrowseComp → ExploitGymlinear79.2 pp25
SciCode → AA Coding Indexlinear159.2 pp1
Vals MMLU-Pro → HLEinverse Michaelis–Menten329.2 pp8
ERQA → SimpleVQAMichaelis–Menten129.2 pp1
Mystery Game Puzzles → StealthMarklinear299.2 pp19
Terminal-Bench Hard → Terminal-Bench 4.1offset logistic59.2 pp15
AA Agentic Index → AA Cyber IndexMichaelis–Menten89.2 pp61
Mystery Game Puzzles → Chess PuzzlesMichaelis–Menten639.3 pp0
Claw-Eval → JobBenchlinear79.3 pp10
AA-Omniscience Accuracy → SuperGPQAHill129.3 pp85
StealthMark → SEC-Bench Prolinear119.3 pp15
CyberGym → ExploitGymoffset logistic119.3 pp7
AA-SciCode → FrontierCode 2.0offset logistic219.3 pp31
Furniture Assembly → EBR-benchlinear279.3 pp12
MathVision → ScreenSpot Prooffset logistic99.3 pp1
BlenderWorld (text-only) → Chess PuzzlesHill59.3 pp0
Mystery Game Puzzles → Furniture AssemblyHill399.3 pp28
HLE w/ tools → Hermes Indexlinear89.3 pp9
OSWorld-Verified → ToolathlonHill119.3 pp4
Gert Labs → CyberGyminverse Michaelis–Menten89.3 pp17
CritPt → AA-GPQA DiamondHill1769.3 pp2
GPQA → ARC-AGI-3offset logistic129.3 pp4
Mystery Game Puzzles → SpireClimbHill129.3 pp22
LiveCodeBench → SWE-bench VerifiedMichaelis–Menten59.3 pp9
Mystery Game Puzzles → SEC-Bench Prolinear119.3 pp22
Video-MME (w/o subtitle) → ERQAMichaelis–Menten59.3 pp0
Agents' Last Exam → DeepsecBench-AAMichaelis–Menten99.4 pp1
Decision Index Arts → Decision Index ToolsMichaelis–Menten + offset1109.4 pp0
Decision Index Language → When2Call (Decision Index)Michaelis–Menten119.4 pp1
Artificial Analysis Intelligence Index → AA-HLEMichaelis–Menten + offset1679.4 pp4
MCP Atlas → OSWorld-VerifiedHill159.4 pp2
ARC-AGI-3 Provider Adapter → ARC-AGI-2Michaelis–Menten + offset129.4 pp1
GDPval-AA → APEX-Agentsinverse Michaelis–Menten79.4 pp94
AutomationBench → AA Cyber Indexoffset logistic109.4 pp16
FrontierPhysics → Chess Puzzleslinear249.4 pp1
CyberGym-E2E-AA → AutomationBenchoffset logistic109.5 pp2
Vals SWE-bench → FrontierSWE v2inverse Michaelis–Menten129.5 pp21
Decision Index Retrieval → Decision Index Languagelinear1109.5 pp0
CWE-Bench-AA → DeepsecBench-AAoffset logistic199.5 pp0
Decision Index Knowledge → When2Call (Decision Index)linear119.5 pp2
CharXiv w/o tools → MathVisionHill99.5 pp0
ScarfBench → AA Coding IndexHill69.5 pp0
BinaryAudit → SkillsBench official leaderboard (BenchFlow)Michaelis–Menten79.5 pp6
Decision Index Language → Decision Index Retrievallinear1109.5 pp0
GDPval-AA → APEX-Agents-AAlinear249.5 pp55
SimpleQA → GPQAMichaelis–Menten159.6 pp0
OCRBench V2 → VideoMMMUHill69.6 pp1
GDPval-AA → DeepSearchQAoffset logistic159.6 pp39
Toolathlon → GDPval-AAMichaelis–Menten + offset199.6 pp0
MMMU-Pro → ScreenSpot ProMichaelis–Menten + offset159.6 pp18
FACTS Multimodal → MaxxBenchHill79.6 pp0
ExploitGym → Agents' Last Examoffset logistic89.6 pp8
VideoMMMU → ERQAMichaelis–Menten + offset89.6 pp0
MirrorCode → MaxxBenchlinear109.7 pp0
AA AutomationBench → Hermes IndexHill69.7 pp0
LiveCodeBench v6 → SWE-bench Verifiedoffset logistic329.7 pp10
GPQA Diamond → ARC-AGI-2linear199.7 pp47
MCP Atlas → HLE w/ toolsMichaelis–Menten199.7 pp1
Chess Puzzles → StealthMarklinear239.7 pp17
GPQA Diamond → Artificial Analysis Intelligence Indexinverse Michaelis–Menten429.8 pp3
SEC-Bench Pro → Chess PuzzlesMichaelis–Menten109.8 pp0
SkillsBench official leaderboard (BenchFlow) → Mystery Game PuzzlesHill149.8 pp5
EBR-bench → ExploitBench Internal Portlinear69.8 pp0
BrowseComp → AA Harvey LAB v1.0Michaelis–Menten + offset59.8 pp24
MCP Atlas → CyberGymoffset logistic129.8 pp2
AA AutomationBench → ExploitGymHill79.8 pp1
Cookie-Bench → NYT ConnectionsMichaelis–Menten + offset59.8 pp0
AA-HLE → ARC-AGI-3offset logistic229.8 pp116
CWE-bench → DeepsecBench-AAMichaelis–Menten99.8 pp0
HealthBench (raw) → Artificial Analysis Intelligence IndexMichaelis–Menten + offset89.8 pp0
Vals MMLU-Pro → AA-HLEoffset logistic749.8 pp0
MCP Atlas → VITA-BenchMichaelis–Menten79.9 pp13
SEC-Bench Pro → EBR-benchHill99.9 pp2
AA-HLE → GPQAoffset logistic919.9 pp0
ARC-AGI-3 → ARC-AGI-2Hill249.9 pp0
Mystery Game Puzzles → CompileBenchlinear510.0 pp51
ScarfBench → Bug Hunt BenchHill910.0 pp0
ExploitGym → CyberGymMichaelis–Menten1110.0 pp4
ProgramBench → AA Coding Indexoffset logistic610.0 pp0
ApprenticeBench → JobBenchlinear710.0 pp0
SWE-bench Verified → Vals LiveCodeBenchHill3210.0 pp30
AA Coding Index → Vibe Code Benchinverse Michaelis–Menten1610.0 pp52
AA-Omniscience Accuracy → HLElinear5410.0 pp4
CritPt → AA-Omniscience Accuracylinear15910.0 pp1
BioMysteryBench (human-difficult) → AA-HLEoffset logistic610.1 pp0
RealWorldQA → V*Hill610.1 pp2
GDPval-AA → CWE-Bench-AAMichaelis–Menten + offset1810.1 pp71
ParseBench-1 → ScreenSpot ProMichaelis–Menten610.1 pp16
DeepSearchQA → ApprenticeBenchHill510.1 pp8
AA-GPQA Diamond → HLEinverse Michaelis–Menten5110.1 pp3
EBR-bench → Chess Puzzleslinear3010.1 pp0
FrontierCode 1.1 Main → FrontierCode 2.0linear1010.1 pp0
SciCode → SWE-bench ProHill2010.1 pp1
DAYJOB Healthcare → ExploitBench Internal PortMichaelis–Menten510.1 pp0
HealthBench Professional (length-adjusted, Artificial Analysis) → AA-HLEinverse Michaelis–Menten610.1 pp0
OCRBench V2 → MMMUMichaelis–Menten + offset510.1 pp0
Artificial Analysis Intelligence Index → SuperGPQAoffset logistic1210.1 pp12
MCP Atlas → GDPval-AAinverse Michaelis–Menten3210.2 pp1
ResearchClawBench → DeepSearchQAMichaelis–Menten610.2 pp3
MaxxBench → Chess PuzzlesHill1410.2 pp0
ResearchClawBench → APEX-Agents-AAMichaelis–Menten910.2 pp3
AA-AnalystAgent → ExploitGymlinear1010.2 pp0
AA-Omniscience Accuracy → GPQAMichaelis–Menten7210.2 pp0
Toolathlon → OSWorld-VerifiedMichaelis–Menten1110.2 pp0
Toolathlon-Verified → Hermes IndexHill810.2 pp1
DeepSWE → FrontierCode 2.0offset logistic2210.2 pp11
Artificial Analysis Intelligence Index → BioBasicsBenchMichaelis–Menten710.2 pp39
ApprenticeBench → DeepsecBench-AAHill610.2 pp1
MaxxBench → NYT Connectionslinear1210.2 pp1
MMMLU → AA-HLEinverse Michaelis–Menten910.3 pp0
SimpleVQA → VideoMMMUHill1110.3 pp2
ExploitBench → NYT Connectionsoffset logistic910.3 pp4
AA-Omniscience Accuracy → AA-GPQA DiamondMichaelis–Menten13610.3 pp3
Gert Labs → JobBenchinverse Michaelis–Menten1510.3 pp9
SpireClimb → ExploitBenchlinear510.3 pp0
BrowseComp → MCP Atlasoffset logistic3510.3 pp13
Chess Puzzles → MaxxBenchlinear1410.3 pp17
Chess Puzzles → SpireClimblinear1110.3 pp13
CWE-Bench-AA → AA Cyber IndexHill2110.3 pp0
Chess Puzzles → Mystery Game Puzzlesinverse Michaelis–Menten6310.3 pp14
MazeBench → DeepsecBench-AAlinear1710.3 pp3
MLVU (M-Avg) → SimpleVQAinverse Michaelis–Menten1010.3 pp0
FrontierPhysics → ExploitBenchHill1210.4 pp1
Toolathlon → AA Agentic Indexoffset logistic1510.4 pp0
DeepSWE → Bug Hunt BenchHill2410.4 pp17
CritPt → HLEHill6110.4 pp1
DynaMath → MMMUHill710.4 pp0
OSWorld 2.0 → ExploitGymMichaelis–Menten1010.4 pp2
OSWorld 2.0 → MCP AtlasMichaelis–Menten810.4 pp2
APEX-Agents-AA → Gert Labslinear1310.4 pp3
PostTrainBench v1.1 → FrontierSWE v2Hill710.4 pp1
Mystery Game Puzzles → EBR-benchlinear3210.4 pp28
Vals GPQA Diamond → HLEinverse Michaelis–Menten3210.4 pp0
CyberGym → AutomationBenchHill1110.4 pp10
DynaMath → MathVisionHill610.5 pp0
Agents' Last Exam → ExploitGymMichaelis–Menten + offset810.5 pp1
Vibe Code Bench → PostTrainBench v1.1Hill510.5 pp9
MMLU-Redux → AA-HLEHill910.5 pp0
ApprenticeBench → ExploitGymMichaelis–Menten610.5 pp0
AA-SciCode → Bug Hunt Benchinverse Michaelis–Menten2310.5 pp38
HealthBench Hard → AA-HLEMichaelis–Menten1210.5 pp0
CWE-Bench-AA → BrowseCompMichaelis–Menten810.6 pp0
ProgramBench → Vals SWE-benchoffset logistic510.6 pp1
We-Math → MathVisionMichaelis–Menten + offset610.6 pp0
JevBench 1.5 → JevBench 1.4offset logistic8610.6 pp18
CWE-bench → ExploitGymlinear710.6 pp0
GDPval-AA → ExploitGymHill1710.6 pp37
Toolathlon-Verified → MKAHill510.6 pp2
MazeBench → CWE-Bench-AAMichaelis–Menten + offset1710.6 pp3
Claw-Eval → VITA-Benchinverse Michaelis–Menten710.7 pp17
NYT Connections → StealthMarkoffset logistic3210.7 pp21
AA Agentic Index → APEX-Agents-AAMichaelis–Menten1810.7 pp0
CritPt → BioBasicsBenchoffset logistic710.7 pp36
Furniture Assembly → SEC-Bench ProMichaelis–Menten1110.7 pp1
cursorBench41 → Bug Hunt BenchHill1210.7 pp0
AIME26 → IMOAnswerBenchMichaelis–Menten510.7 pp11
Terminal-Bench 4.1 → Terminal-Bench-Science 0.1linear1210.7 pp30
MKA → Agents' Last ExamMichaelis–Menten810.7 pp10
HLE → Artificial Analysis Intelligence Indexlinear5210.7 pp3
BrowseComp → JobBenchlinear1210.7 pp7
DeepPlanning → MCP Atlaslinear710.7 pp0
GDPval-AA → MCP AtlasHill3210.7 pp33
ExploitBench Internal Port → NYT ConnectionsMichaelis–Menten + offset610.8 pp0
Furniture Assembly → Mystery Game Puzzlesoffset logistic3910.8 pp0
Video-MME (with subtitle) → SimpleVQAinverse Michaelis–Menten1010.8 pp0
StealthMark → Chess PuzzlesMichaelis–Menten2310.8 pp11
FrontierPhysics → ExploitBench Internal Portlinear710.8 pp1
Hermes Bench → ExploitGymHill610.8 pp0
RealWorldQA → MMMU-ProHill1210.8 pp1
IMOAnswerBench → AIME26Michaelis–Menten510.8 pp1
AA-MMMU-Pro → ScreenSpot ProMichaelis–Menten + offset1310.8 pp46
GPQA → ARC-AGI-2linear2110.9 pp45
OpenHarmony Bench v1.2 → DeepSWEoffset logistic510.9 pp0
Terminal-Bench 2.1 → Terminal-Bench 4.1linear2310.9 pp49
ScreenSpot Pro → MathVisionMichaelis–Menten910.9 pp4
We-Math → V*Michaelis–Menten510.9 pp0
Agents' Last Exam → AutomationBenchoffset logistic1710.9 pp0
ERQA → Video-MME (w/o subtitle)Michaelis–Menten510.9 pp1
DRACO → Hermes Indexlinear510.9 pp0
MazeBench → Agents' Last Examlinear1211.0 pp24
MaxxBench → EBR-benchHill511.0 pp0
τ²-bench results → GDPval-AAHill6611.0 pp49
Furniture Assembly → Chess Puzzleslinear3811.0 pp0
AIME 2025 → HMMT Feb 2026offset logistic511.0 pp35
HealthBench Professional → ARC-AGI-3 Provider Adapteroffset logistic711.0 pp2
MCP Atlas → ApprenticeBenchHill511.0 pp14
Hermes Index → AA AutomationBenchoffset logistic611.0 pp1
MKA → AA AutomationBenchHill1611.0 pp1
Bug Hunt Bench → OpenHarmony Bench v1.2offset logistic511.0 pp23
Harvey LAB-AA v1.1 → DeepsecBench-AAoffset logistic611.0 pp0
Terminal-Bench 2.1 → AA Terminal-Bench 4.0offset logistic511.0 pp40
FACTS Multimodal → Chess Puzzlesinverse Michaelis–Menten2011.0 pp0
BabaIsBench → Chess Puzzlesoffset logistic2611.1 pp1
FACTS Multimodal → StealthMarkoffset logistic1711.1 pp0
Bug Hunt Bench → FrontierSWE v2Michaelis–Menten2011.1 pp2
BabaIsBench → MaxxBenchMichaelis–Menten + offset911.1 pp1
React Native Evals → AA Coding IndexHill911.1 pp3
CyberGym → MCP AtlasHill1211.1 pp4
OSWorld-Verified → JobBenchoffset logistic1511.1 pp4
WideResearch → CyberGymHill511.1 pp0
Gert Labs → APEX-Agents-AAlinear1311.2 pp9
HMMT Nov 2025 → FrontierMath v2 (Tiers 1-3)Hill611.2 pp1
PostTrainBench → FrontierSWE v2linear1011.2 pp1
DeepSearchQA → Gert Labsoffset logistic811.2 pp1
SWE-bench Pro → DeepSWEMichaelis–Menten + offset2511.2 pp10
ERQA → V*Michaelis–Menten611.2 pp4
AA-LCR → MRCRv2offset logistic911.3 pp202
OSWorld-Verified → CyberGymHill1011.3 pp4
GDP.pdf → JobBenchHill511.3 pp8
We-Math → MMMU-Prooffset logistic611.3 pp0
OTelBench → SkillsBench official leaderboard (BenchFlow)linear511.3 pp1
StealthMark → EBR-benchinverse Michaelis–Menten1211.3 pp11
MazeBench → BrowseCompMichaelis–Menten + offset1411.3 pp4
Hermes Bench → AA AutomationBenchHill611.4 pp0
AA-Omniscience Accuracy → AA-HLElinear15911.4 pp0
DAYJOB → EBR-benchHill1111.4 pp0
MMLU-ProX → PolyMathoffset logistic511.4 pp7
JobBench → CyberGymMichaelis–Menten1211.4 pp3
AA Agentic Index → CWE-Bench-AAMichaelis–Menten811.4 pp0
ERQA → ScreenSpot ProHill1011.4 pp0
DeepsecBench-AA → Agents' Last ExamHill911.4 pp1
τ²-bench results → APEX-Agents-AAoffset logistic2111.4 pp35
Vals LiveCodeBench → AA Coding Indexlinear4911.5 pp5
SpireClimb → StealthMarkMichaelis–Menten + offset911.5 pp0
We-Math → MMMUMichaelis–Menten + offset611.5 pp0
CyberGym → DeepSearchQAoffset logistic511.5 pp4
APEX-Agents-AA → GDPval-AAlinear2411.5 pp0
Hermes Index → AA Agentic IndexMichaelis–Menten + offset511.5 pp0
CharXiv → BabyVisionoffset logistic1011.5 pp8
DeepSearchQA → APEX-Agents-AAoffset logistic711.5 pp1
BrowseComp → Agents' Last ExamHill611.6 pp31
CharXiv w/o tools → ScreenSpot Proinverse Michaelis–Menten511.6 pp0
HLE → ARC-AGI-1Michaelis–Menten1611.6 pp3
SpireClimb → Furniture AssemblyHill1211.7 pp0
SimpleQA → AA-GPQA Diamondlinear911.7 pp0
FrontierPhysics → Mystery Game PuzzlesHill2511.7 pp1
MMLU-Pro → SimpleQAlinear811.7 pp14
HLE w/ tools → MCP AtlasMichaelis–Menten1911.7 pp0
HealthBench Professional → ARC-AGI-3offset logistic1211.8 pp1
MedXpertQA (MM) → CharXivMichaelis–Menten611.8 pp0
PostTrainBench → Bug Hunt BenchHill1311.8 pp0
Toolathlon → MCP Atlasinverse Michaelis–Menten1711.8 pp0
BrowseComp → τ²-bench resultsHill2511.8 pp19
FrontierPhysics → EBR-benchMichaelis–Menten + offset1511.8 pp1
DAYJOB → Chess Puzzleslinear1911.8 pp0
QwenClawBench → DeepPlanninginverse Michaelis–Menten711.8 pp2
DAYJOB → Mystery Game PuzzlesMichaelis–Menten + offset1911.9 pp0
Furniture Assembly → SpireClimblinear1211.9 pp0
BioMysteryBench (human-difficult) → CritPtoffset logistic611.9 pp0
CritPt → GPQAHill8411.9 pp1
ARC-AGI-1 → BioBasicsBenchoffset logistic711.9 pp0
Artificial Analysis Intelligence Index → HLElinear5212.0 pp1
SkillsBench official leaderboard (BenchFlow) → BinaryAuditinverse Michaelis–Menten712.0 pp13
AI2D_TEST → MMMUHill812.0 pp0
MMLU-Pro → Vals GPQA Diamondinverse Michaelis–Menten1012.1 pp1
MaxxBench → Furniture Assemblyinverse Michaelis–Menten1012.1 pp1
NYT Connections → BinaryAuditoffset logistic1112.1 pp61
BabaIsBench → NYT Connectionslinear2612.1 pp1
SWE-bench Pro → Bug Hunt BenchMichaelis–Menten812.1 pp16
Artificial Analysis Intelligence Index → AA-GPQA DiamondHill14712.1 pp1
AA Agentic Index → ExploitGymlinear712.2 pp4
APEX-Agents-AA → AA Agentic IndexMichaelis–Menten + offset1812.2 pp2
DeepSearchQA → GDPval-AAlinear1512.2 pp1
QwenClawBench → MCP Atlasoffset logistic812.3 pp1
ERQA → MMMUMichaelis–Menten612.3 pp0
Chess Puzzles → SEC-Bench ProMichaelis–Menten1012.3 pp18
Vals SWE-bench → ScarfBenchinverse Michaelis–Menten512.3 pp16
NYT Connections → Chess PuzzlesHill5412.3 pp19
RealWorldQA → SimpleVQAHill1112.3 pp2
ExploitBench → ExploitBench Internal PortHill712.3 pp3
BFCL v4 → τ²-bench resultsMichaelis–Menten712.4 pp16
StealthMark → Furniture AssemblyHill2112.4 pp11
We-Math → SimpleVQAMichaelis–Menten612.4 pp0
Toolathlon-Verified → APEX-Agentsoffset logistic512.4 pp4
BabaIsBench → Mystery Game Puzzlesoffset logistic2612.4 pp1
MMLU-Pro → SuperGPQAinverse Michaelis–Menten1812.4 pp25
DeepSearchQA → AA Agentic IndexHill812.5 pp0
MazeBench → ApprenticeBenchlinear1612.5 pp22
AA Agentic Index → JobBenchoffset logistic612.5 pp0
LongBench v2 → AA-LCRinverse Michaelis–Menten1712.5 pp7
Hermes Bench → Agents' Last Examinverse Michaelis–Menten712.6 pp0
Cookie-Bench → Mystery Game Puzzleslinear512.6 pp2
StealthMark → ExploitBenchinverse Michaelis–Menten1112.6 pp9
Chess Puzzles → NYT ConnectionsMichaelis–Menten5412.6 pp24
MCP Atlas → APEX-Agentslinear612.6 pp10
AA Cyber Index → AA Agentic Indexlinear812.7 pp2
Chess Puzzles → EBR-benchinverse Michaelis–Menten3012.7 pp15
SWE-bench Verified → DeepSWEHill1212.7 pp27
STEMBench → AA-Omniscience Accuracyinverse Michaelis–Menten812.7 pp0
τ²-bench results → AA Agentic Indexlinear4012.7 pp51
SkillsBench official leaderboard (BenchFlow) → Chess Puzzleslinear1712.8 pp0
AA Harvey LAB v1.0 → GDPval-AAoffset logistic1212.8 pp0
HLE w/ tools → AA Cyber IndexMichaelis–Menten + offset812.8 pp16
MazeBench → AA AutomationBenchHill1912.8 pp15
AA EnterpriseOps-Gym → JobBenchHill512.8 pp0
ProgramBench → SWE-MarathonMichaelis–Menten712.9 pp7
ResearchClawBench → MCP AtlasHill1312.9 pp3
SuperGPQA → GPQA DiamondMichaelis–Menten + offset712.9 pp2
BioBasicsBench → ARC-AGI-2Michaelis–Menten + offset712.9 pp0
DAYJOB Healthcare → Chess Puzzleslinear1912.9 pp0
GDP.pdf → Agents' Last ExamMichaelis–Menten + offset512.9 pp1
CountBench → MMMUHill1013.0 pp0
HLE w/o tools → ARC-AGI-2Hill1813.0 pp8
τ²-bench results → BrowseCompMichaelis–Menten + offset2513.0 pp50
MCP Atlas → DeepPlanningMichaelis–Menten + offset713.1 pp42
Vals LiveCodeBench → SWE-bench Verifiedinverse Michaelis–Menten3213.1 pp5
StealthMark → Mystery Game Puzzlesinverse Michaelis–Menten2913.3 pp10
CWE-bench v1 → AA Agentic Indexinverse Michaelis–Menten513.3 pp0
VITA-Bench → MCP Atlaslinear713.3 pp1
OSWorld 2.0 → AA Cyber Indexinverse Michaelis–Menten713.3 pp2
ZeroBench → BabyVisionMichaelis–Menten613.4 pp0
GPQA → SimpleQAoffset logistic1513.4 pp37
Chess Puzzles → ExploitBenchinverse Michaelis–Menten913.4 pp18
Claw-Eval → MCP Atlaslinear1913.5 pp7
DAYJOB Healthcare → SEC-Bench Prolinear813.5 pp0
BrowseComp → AA Cyber IndexMichaelis–Menten + offset813.5 pp22
SEC-Bench Pro → Mystery Game Puzzlesinverse Michaelis–Menten1113.6 pp0
BabaIsBench → EBR-benchinverse Michaelis–Menten1213.6 pp0
Terminal-Bench 2.1 (Vals AI) → AA Terminal-Bench 4.0linear713.7 pp24
AA Cyber Index → BrowseCompMichaelis–Menten813.7 pp0
CountBench → SimpleVQAHill813.7 pp0
MazeBench → OSWorld 2.1 Offlineoffset logistic1113.8 pp6
NYT Connections → ExploitBench Internal PortHill613.8 pp9
Vals GPQA Diamond → ARC-AGI-2linear3113.8 pp22
Mystery Game Puzzles → NYT ConnectionsHill5413.8 pp5
CursorBench 3.2 → FrontierSWE v2Hill713.8 pp0
GPQA Diamond → SuperGPQAHill713.9 pp12
Hermes Index → Agents' Last Examlinear713.9 pp0
HLE w/ tools → CyberGymMichaelis–Menten714.0 pp0
DynaMath → VideoMMMUoffset logistic714.0 pp0
AA-SciCode → ScarfBenchinverse Michaelis–Menten1014.0 pp18
Chess Puzzles → Furniture Assemblyoffset logistic3814.1 pp17
BioMysteryBench (human-difficult) → AA-Omniscience AccuracyMichaelis–Menten + offset614.1 pp0
ERQA → VideoMMMUMichaelis–Menten + offset814.1 pp0
WideResearch → GDPval-AAinverse Michaelis–Menten614.1 pp0
MaxxBench → BabaIsBenchMichaelis–Menten + offset914.1 pp4
ExploitBench Internal Port → MirrorCodeoffset logistic714.2 pp2
BFCL v4 → MCP Atlasoffset logistic714.2 pp5
MATH-500 → AIME 2025linear1714.2 pp2
AA-SciCode → FrontierSWE v2Hill2014.2 pp33
Terminal-Bench 4.0 → Terminal-Bench-Science 0.1Hill1114.2 pp10
AA Coding Index → FrontierSWE v2Hill1314.3 pp7
CritPt → ARC-AGI-2linear3914.4 pp89
AA-HLE → MMLU-ProHill5014.4 pp1
AA-HLE → ARC-AGI-2Hill3814.4 pp12
HealthBench (length-adjusted) → ARC-AGI-3linear514.4 pp0
ResearchClawBench → JobBenchinverse Michaelis–Menten514.4 pp1
Gert Labs → MCP Atlasinverse Michaelis–Menten1414.6 pp7
SWE-bench Verified → LiveCodeBenchMichaelis–Menten514.6 pp107
NYT Connections → Mystery Game PuzzlesHill5414.6 pp13
Artificial Analysis Intelligence Index → ARC-AGI-2Michaelis–Menten + offset4014.6 pp7
HealthBench Professional (raw, Artificial Analysis) → AA-Omniscience Accuracyinverse Michaelis–Menten614.7 pp0
CWE-Bench-AA → OSWorld 2.0Hill714.7 pp8
DeepSearchQA → JobBenchoffset logistic914.8 pp1
DAYJOB Healthcare → EBR-benchHill1114.8 pp0
ExploitBench → MirrorCodeoffset logistic914.9 pp7
Terminal-Bench 2.1 (Vals AI) → Terminal-Bench 4.1inverse Michaelis–Menten3214.9 pp18
SEC-Bench Pro → MirrorCodeinverse Michaelis–Menten1015.0 pp1