benchgap
Other · model

Trinity-Large-Thinking benchmark scores

As of 2026-11-21, Trinity-Large-Thinking (Other) has measured scores on 15 benchmarks and estimated scores on 88 more.

BenchmarkScoreSource
AA-GPQA Diamond75.2%measured
AA-HLE15.8%measured
AA-SciCode40.6%measured
Artificial Analysis Intelligence Index14.0%estimated ± 7.2 pp, medium confidence
CritPt0.9%measured
GDPval-AA0.0%measured
GPQA Diamond76.3%measured
HLE11.5%estimated ± 6.8 pp, medium confidence
IFBench52.3%measured
AA-LCR38.0%measured
LiveCodeBench v675.8%estimated ± 4.7 pp, high confidence
AA-Omniscience Accuracy21.1%estimated ± 7.7 pp, medium confidence
SciCode40.7%estimated ± 3.1 pp, high confidence
BrowseComp56.2%estimated ± 6.6 pp, medium confidence
HLE w/ tools33.8%estimated ± 5.3 pp, low confidence
IFEval91.9%estimated ± 2.8 pp, high confidence
LongBench v251.4%estimated ± 5.5 pp, medium confidence
τ²-bench results90.1%measured
AA Coding Index25.8%measured
APEX-Agents0.0%estimated ± 9.4 pp, low confidence
APEX-Agents-AA6.0%estimated ± 9.5 pp, medium confidence
BioMysteryBench (human-difficult)15.7%estimated ± 6.8 pp, low confidence
DeepSearchQA23.2%estimated ± 4.5 pp, medium confidence
SWE-bench Verified66.8%estimated ± 6.3 pp, medium confidence
BFCL v453.9%estimated ± 2.7 pp, high confidence
CyberGym46.4%estimated ± 5.3 pp, low confidence
JobBench0.0%estimated ± 8.7 pp, low confidence
SWE-bench Pro32.9%estimated ± 6.0 pp, medium confidence
WideResearch34.6%estimated ± 5.9 pp, low confidence
AA Agentic Index1.2%measured
MMLU-Pro79.5%estimated ± 5.4 pp, medium confidence
AA-IFBench56.3%measured
FailureSensorIQ62.6%estimated ± 1.7 pp, high confidence
GPQA76.2%estimated ± 1.2 pp, high confidence
MMLU88.0%estimated ± 8.3 pp, medium confidence
Vals GPQA Diamond76.3%estimated ± 2.1 pp, medium confidence
Vals LiveCodeBench77.1%estimated ± 5.7 pp, low confidence
Vals MMLU-Pro78.6%estimated ± 1.6 pp, medium confidence
MMMLU86.3%estimated ± 0.7 pp, medium confidence
Chess Puzzles19.3%estimated ± 12.3 pp, low confidence
AA MMLU-Pro85.7%estimated ± 1.3 pp, high confidence
Gert Labs32.6%measured
AA Harvey LAB v1.079.4%estimated ± 1.2 pp, low confidence
AA Tau3 Banking16.7%estimated ± 3.7 pp, medium confidence
ARC-AGI-175.4%estimated ± 7.8 pp, low confidence
ARC-AGI-232.3%estimated ± 14.4 pp, low confidence
CursorBench 3.238.7%estimated ± 5.3 pp, low confidence
FrontierCode 1.1 Main0.0%estimated ± 6.6 pp, low confidence
FrontierSWE v25.9%estimated ± 14.2 pp, low confidence
MazeBench0.4%estimated ± 5.5 pp, low confidence
Mystery Game Puzzles13.5%estimated ± 14.6 pp, low confidence
NYT Connections16.5%measured
OSWorld-Verified54.0%estimated ± 5.5 pp, medium confidence
Vals SWE-bench49.8%estimated ± 5.5 pp, medium confidence
CWE-Bench-AA0.0%estimated ± 10.1 pp, low confidence
AA Cyber Index0.9%estimated ± 9.2 pp, low confidence
DeepsecBench-AA0.0%estimated ± 8.9 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)1.4%estimated ± 2.1 pp, low confidence
AA ITBench36.0%estimated ± 2.8 pp, medium confidence
Bug Hunt Bench15.0%estimated ± 10.5 pp, low confidence
CursorBench 4.027.1%estimated ± 4.9 pp, medium confidence
CWE-bench v10.0%estimated ± 6.4 pp, low confidence
DeepSWE33.6%estimated ± 7.5 pp, low confidence
DRACO0.0%estimated ± 2.0 pp, low confidence
FrontierCode 2.026.1%estimated ± 9.3 pp, low confidence
HLE w/o tools11.1%estimated ± 4.3 pp, high confidence
PostTrainBench v1.125.6%estimated ± 7.4 pp, low confidence
StealthMark41.3%estimated ± 10.7 pp, low confidence
Toolathlon-Verified4.6%estimated ± 2.3 pp, low confidence
VulcanBench Frontier v470.4%estimated ± 6.8 pp, low confidence
GDP.pdf17.0%estimated ± 4.6 pp, medium confidence
ARC-AGI-31.3%estimated ± 9.8 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
SkillsBench official leaderboard (BenchFlow)30.1%estimated ± 6.1 pp, medium confidence
BinaryAudit9.9%estimated ± 12.1 pp, low confidence
OTelBench6.8%estimated ± 6.6 pp, medium confidence
Vibe Code Bench7.6%estimated ± 10.0 pp, low confidence
Hermes Bench0.0%estimated ± 2.9 pp, medium confidence
Hermes Index0.0%estimated ± 8.7 pp, low confidence
C-Eval91.7%estimated ± 1.1 pp, medium confidence
Claw-Eval51.0%estimated ± 6.8 pp, low confidence
MCP Atlas64.6%estimated ± 7.8 pp, low confidence
MMLU-Redux90.3%estimated ± 2.8 pp, high confidence
NL2Repo16.2%estimated ± 4.7 pp, medium confidence
QwenClawBench55.9%estimated ± 6.0 pp, low confidence
SuperGPQA53.0%estimated ± 13.9 pp, low confidence
Toolathlon27.0%estimated ± 6.3 pp, low confidence
AA LiveCodeBench84.0%estimated ± 4.7 pp, low confidence
HealthBench Hard8.9%estimated ± 8.6 pp, low confidence
MMLU-Pro (Arcee)83.4%measured
React Native Evals70.5%estimated ± 3.2 pp, high confidence
ResearchClawBench2.3%estimated ± 1.9 pp, medium confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
HealthBench (raw)22.6%estimated ± 6.0 pp, low confidence
HealthBench (length-adjusted)44.4%estimated ± 3.4 pp, low confidence
HealthBench Professional58.1%estimated ± 4.5 pp, low confidence
HealthBench Professional (raw)35.0%estimated ± 4.5 pp, medium confidence
ScarfBench24.4%estimated ± 9.1 pp, low confidence
SimpleQA26.2%estimated ± 7.8 pp, medium confidence
OpenHarmony Bench v1.051.0%estimated ± 2.4 pp, medium confidence
MRCRv222.8%estimated ± 11.3 pp, low confidence
MMLongBench-Doc57.9%estimated ± 2.6 pp, low confidence
BioBasicsBench33.9%estimated ± 10.7 pp, low confidence