benchgap
Other · model

Inkling benchmark scores

As of 2026-11-21, Inkling (Other) has measured scores on 36 benchmarks and estimated scores on 156 more.

BenchmarkScoreSource
AA-GPQA Diamond87.2%measured
AA-HLE31.9%measured
AA-SciCode47.0%measured
AIME2697.1%measured
Artificial Analysis Intelligence Index12.5%measured
CritPt5.4%measured
GDPval-AA28.6%measured
GPQA Diamond87.9%measured
HLE46.0%measured
IFBench79.8%measured
AA-LCR77.3%measured
LiveCodeBench v688.9%estimated ± 2.2 pp, medium confidence
AA-Omniscience Accuracy39.3%measured
SciCode47.7%estimated ± 2.9 pp, medium confidence
Terminal-Bench 2.163.8%measured
BrowseComp77.1%measured
HLE w/ tools47.6%estimated ± 5.3 pp, medium confidence
IFEval94.6%estimated ± 3.6 pp, high confidence
LongBench v263.4%estimated ± 5.5 pp, medium confidence
VITA-Bench43.8%estimated ± 6.7 pp, low confidence
τ²-bench results92.8%estimated ± 11.8 pp, low confidence
AA Coding Index52.1%measured
AA-MMMU-Pro73.5%measured
APEX-Agents21.1%estimated ± 9.4 pp, low confidence
APEX-Agents-AA23.2%estimated ± 4.4 pp, high confidence
BioMysteryBench (human-difficult)38.0%estimated ± 6.8 pp, low confidence
DeepSearchQA86.8%estimated ± 4.5 pp, high confidence
SWE-bench Verified77.6%measured
BFCL v474.1%estimated ± 2.7 pp, high confidence
CyberGym64.2%estimated ± 5.3 pp, low confidence
JobBench46.3%estimated ± 7.9 pp, medium confidence
SkillsBench48.3%estimated ± 4.1 pp, medium confidence
SWE-bench Pro54.3%measured
WideResearch76.4%estimated ± 3.5 pp, high confidence
AA Agentic Index24.3%measured
MMLU-Pro85.2%estimated ± 2.5 pp, medium confidence
AA-IFBench80.3%estimated ± 7.4 pp, medium confidence
FailureSensorIQ64.9%estimated ± 2.1 pp, high confidence
GPQA87.9%measured
MMLU90.5%estimated ± 0.9 pp, medium confidence
Vals GPQA Diamond87.1%measured
Vals LiveCodeBench85.5%measured
Vals MMLU-Pro86.3%measured
MATH-50097.9%estimated ± 3.1 pp, low confidence
MMMLU88.5%estimated ± 0.7 pp, medium confidence
MMMU82.0%estimated ± 0.8 pp, high confidence
Chess Puzzles21.0%measured
AIME 202598.2%estimated ± 1.8 pp, low confidence
AA MMLU-Pro87.2%estimated ± 0.7 pp, high confidence
Gert Labs59.0%estimated ± 7.1 pp, medium confidence
AA-AnalystAgent46.5%estimated ± 3.7 pp, low confidence
AA Harvey LAB v1.083.4%estimated ± 1.2 pp, medium confidence
AA Tau3 Banking33.6%estimated ± 3.6 pp, medium confidence
AA Terminal-Bench 2.179.6%estimated ± 2.5 pp, medium confidence
ApprenticeBench13.0%estimated ± 11.0 pp, low confidence
ARC-AGI-186.0%estimated ± 2.5 pp, medium confidence
ARC-AGI-245.5%estimated ± 9.7 pp, low confidence
CursorBench 3.136.6%estimated ± 3.4 pp, low confidence
CursorBench 3.249.1%estimated ± 3.6 pp, medium confidence
EBR-bench10.0%estimated ± 12.7 pp, low confidence
Terminal-Bench 3.07.1%estimated ± 3.2 pp, medium confidence
FrontierCode 1.1 Main22.4%estimated ± 3.8 pp, low confidence
FrontierMath v2 (Tier 4)4.9%measured
FrontierMath v2 (Tiers 1-3)33.3%measured
FrontierSWE v24.1%measured
Furniture Assembly27.2%estimated ± 14.1 pp, low confidence
MaxxBench41.0%estimated ± 10.3 pp, low confidence
MazeBench0.4%estimated ± 5.5 pp, low confidence
Mystery Game Puzzles14.2%estimated ± 10.3 pp, low confidence
NYT Connections63.8%estimated ± 12.6 pp, low confidence
OfficeQA Pro50.3%estimated ± 6.8 pp, low confidence
OSWorld-Verified69.4%estimated ± 5.7 pp, medium confidence
ParseBench-161.6%estimated ± 1.0 pp, medium confidence
Terminal-Bench 4.10.0%measured
Terminal-Bench Hard52.5%estimated ± 2.8 pp, low confidence
Vals SWE-bench77.6%measured
Terminal-Bench 2.1 (Vals AI)47.6%measured
VulcanBench v383.9%estimated ± 5.6 pp, low confidence
CWE-Bench-AA49.3%estimated ± 6.4 pp, medium confidence
AA Cyber Index16.0%estimated ± 9.2 pp, low confidence
DeepsecBench-AA2.7%estimated ± 8.9 pp, low confidence
HealthBench Professional (length-adjusted, Artificial Analysis)49.6%estimated ± 4.3 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)43.4%estimated ± 0.8 pp, low confidence
AA ITBench40.6%estimated ± 4.0 pp, high confidence
Bug Hunt Bench25.3%estimated ± 7.7 pp, low confidence
Chartography (tools)79.3%estimated ± 4.1 pp, low confidence
CursorBench 4.031.7%estimated ± 2.6 pp, medium confidence
CWE-bench v137.0%measured
DeepSWE42.1%estimated ± 4.3 pp, medium confidence
DRACO75.1%estimated ± 2.0 pp, medium confidence
FrontierCode 2.024.3%estimated ± 4.8 pp, medium confidence
FrontierPhysics0.0%estimated ± 6.1 pp, low confidence
HLE w/o tools30.0%measured
OSWorld 2.143.8%estimated ± 6.0 pp, low confidence
OSWorld 2.1 Offline5.3%estimated ± 1.9 pp, low confidence
PostTrainBench v1.122.1%estimated ± 3.7 pp, medium confidence
SpireClimb0.0%estimated ± 10.3 pp, low confidence
StealthMark37.5%estimated ± 9.7 pp, low confidence
Terminal-Bench 4.09.2%estimated ± 4.5 pp, medium confidence
Toolathlon-Verified53.7%estimated ± 2.3 pp, low confidence
VulcanBench Frontier v477.2%estimated ± 6.8 pp, low confidence
GDP.pdf17.0%estimated ± 4.6 pp, medium confidence
AA Terminal-Bench 4.00.0%estimated ± 6.2 pp, low confidence
ARC-AGI-30.6%estimated ± 7.2 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
cursorBench4144.8%estimated ± 3.7 pp, medium confidence
CWE-bench40.1%estimated ± 5.8 pp, low confidence
MKA23.9%estimated ± 6.4 pp, low confidence
SkillsBench official leaderboard (BenchFlow)49.4%estimated ± 6.2 pp, medium confidence
Vibe Code Bench16.6%estimated ± 8.4 pp, medium confidence
FACTS Multimodal36.6%estimated ± 5.6 pp, medium confidence
Hermes Bench69.6%estimated ± 2.4 pp, low confidence
Hermes Index25.8%estimated ± 8.7 pp, medium confidence
ParseBench-262.8%estimated ± 5.0 pp, medium confidence
CharXiv82.0%measured
CharXiv w/o tools78.1%measured
ExploitBench21.4%estimated ± 13.4 pp, low confidence
ExploitGym7.6%estimated ± 5.5 pp, low confidence
AI2D_TEST93.5%estimated ± 0.9 pp, medium confidence
C-Eval89.3%estimated ± 1.0 pp, medium confidence
Claw-Eval70.0%estimated ± 6.3 pp, low confidence
CountBench93.9%estimated ± 2.9 pp, medium confidence
DeepPlanning47.2%estimated ± 13.1 pp, low confidence
DynaMath86.3%estimated ± 0.8 pp, medium confidence
ERQA59.7%estimated ± 2.9 pp, medium confidence
HMMT Feb 202597.6%estimated ± 1.9 pp, low confidence
HMMT Feb 202685.4%estimated ± 1.5 pp, medium confidence
HMMT Nov 202592.6%estimated ± 1.5 pp, medium confidence
MathVision82.3%estimated ± 3.0 pp, high confidence
MCP Atlas74.1%measured
MLVU (M-Avg)86.3%estimated ± 1.5 pp, high confidence
MMAnswerBench86.5%estimated ± 1.3 pp, high confidence
MMLU-Redux95.9%estimated ± 0.8 pp, medium confidence
MMMU-Pro73.5%measured
NL2Repo43.9%estimated ± 4.7 pp, high confidence
PostTrainBench v121.4%estimated ± 3.6 pp, high confidence
QwenClawBench61.8%estimated ± 2.6 pp, high confidence
RealWorldQA84.2%estimated ± 1.5 pp, high confidence
ScreenSpot Pro74.8%estimated ± 6.8 pp, medium confidence
SimpleVQA61.0%estimated ± 7.5 pp, medium confidence
SuperGPQA85.5%estimated ± 7.2 pp, medium confidence
Terminal-Bench 2.056.7%estimated ± 5.8 pp, medium confidence
Toolathlon46.6%estimated ± 4.2 pp, high confidence
V*100.0%estimated ± 7.5 pp, medium confidence
Video-MME (w/o subtitle)82.0%estimated ± 1.3 pp, high confidence
Video-MME (with subtitle)87.4%estimated ± 2.9 pp, high confidence
VideoMMMU85.6%estimated ± 1.5 pp, medium confidence
We-Math80.2%estimated ± 7.4 pp, low confidence
AA LiveCodeBench90.3%estimated ± 2.6 pp, medium confidence
HealthBench Hard0.0%estimated ± 5.1 pp, low confidence
LiveCodeBench Pro79.1%estimated ± 6.0 pp, low confidence
MedXpertQA (MM)59.6%estimated ± 2.4 pp, high confidence
MedXpertQA (Text)48.1%estimated ± 4.5 pp, low confidence
MMLU-Pro (Arcee)86.2%estimated ± 3.4 pp, medium confidence
React Native Evals78.6%estimated ± 2.7 pp, medium confidence
ResearchClawBench18.7%estimated ± 1.8 pp, high confidence
SWE-Rebench60.9%estimated ± 3.6 pp, medium confidence
PostTrainBench33.1%estimated ± 2.4 pp, medium confidence
DAYJOB0.4%estimated ± 6.3 pp, medium confidence
DAYJOB Healthcare0.1%estimated ± 6.1 pp, low confidence
BioMysteryBench (human-solvable)81.8%estimated ± 0.6 pp, low confidence
FrontierCode 1.1 Extended54.0%estimated ± 3.0 pp, low confidence
HealthBench (raw)40.9%estimated ± 6.0 pp, low confidence
HealthBench (length-adjusted)50.5%estimated ± 3.4 pp, low confidence
HealthBench Professional40.1%estimated ± 4.2 pp, low confidence
HealthBench Professional (raw)51.9%estimated ± 4.5 pp, medium confidence
HLE-Verified15.3%estimated ± 2.0 pp, low confidence
LABBench281.1%estimated ± 1.8 pp, low confidence
ScarfBench45.2%estimated ± 4.5 pp, low confidence
BlenderWorld (text-only)70.6%estimated ± 4.0 pp, medium confidence
Cookie-Bench77.3%estimated ± 2.5 pp, medium confidence
STEMBench2.5%estimated ± 0.2 pp, medium confidence
SimpleQA44.6%estimated ± 4.3 pp, low confidence
LiveCodeBench77.8%estimated ± 14.6 pp, low confidence
Agents' Last Exam24.6%estimated ± 11.6 pp, low confidence
BabyVision w/ Python85.7%estimated ± 3.7 pp, low confidence
OpenHarmony Bench v1.051.0%estimated ± 2.4 pp, high confidence
SEC-Bench Pro31.8%estimated ± 12.3 pp, low confidence
IMOAnswerBench75.1%estimated ± 10.7 pp, low confidence
BabyVision44.6%estimated ± 7.4 pp, low confidence
MMVU74.4%estimated ± 2.7 pp, medium confidence
PerceptionBench55.3%estimated ± 3.8 pp, low confidence
ZeroBench15.8%estimated ± 7.1 pp, low confidence
MRCRv285.3%estimated ± 11.3 pp, low confidence
LVBench65.3%estimated ± 8.2 pp, low confidence
MMLongBench-Doc61.3%estimated ± 2.6 pp, low confidence
OCRBench V269.9%estimated ± 3.3 pp, high confidence
BioBasicsBench33.9%estimated ± 2.8 pp, low confidence
LifeVal68.1%estimated ± 1.6 pp, medium confidence
MMMU-Pro w/ Python76.9%estimated ± 2.0 pp, high confidence
ExploitBench Internal Port0.0%estimated ± 1.4 pp, low confidence
PinchBench90.0%estimated ± 3.6 pp, medium confidence