benchgap
Alibaba (Qwen) · model

Qwen3.6-27B benchmark scores

As of 2026-11-22, Qwen3.6-27B (Alibaba (Qwen)) has measured scores on 52 benchmarks and estimated scores on 137 more.

BenchmarkScoreSource
AA-GPQA Diamond84.2%measured
AA-HLE23.1%measured
AA-SciCode42.8%measured
AIME2694.1%measured
Artificial Analysis Intelligence Index21.4%measured
CritPt1.1%measured
GDPval-AA24.3%measured
GPQA Diamond87.9%estimated ± 1.2 pp, high confidence
HLE24.0%measured
IFBench65.7%estimated ± 6.6 pp, medium confidence
AA-LCR77.3%measured
LiveCodeBench v683.9%measured
AA-Omniscience Accuracy19.6%measured
SciCode42.9%estimated ± 3.1 pp, high confidence
BrowseComp70.6%estimated ± 8.8 pp, medium confidence
HLE w/ tools45.5%estimated ± 5.3 pp, low confidence
IFEval92.7%estimated ± 2.8 pp, high confidence
LongBench v263.4%estimated ± 5.5 pp, medium confidence
VITA-Bench38.4%estimated ± 8.2 pp, low confidence
τ²-bench results94.2%measured
AA Coding Index53.7%measured
AA-MMMU-Pro74.6%measured
APEX-Agents17.5%estimated ± 9.4 pp, low confidence
APEX-Agents-AA16.2%estimated ± 9.3 pp, medium confidence
BioMysteryBench (human-difficult)18.0%estimated ± 6.8 pp, low confidence
DeepSearchQA84.3%estimated ± 4.5 pp, high confidence
SWE-bench Verified77.2%measured
BFCL v473.3%estimated ± 2.7 pp, high confidence
CyberGym61.0%estimated ± 5.3 pp, low confidence
JobBench21.3%estimated ± 8.7 pp, medium confidence
SWE-bench Pro53.5%measured
WideResearch72.5%estimated ± 3.3 pp, high confidence
AA Agentic Index20.1%measured
MMLU-Pro86.2%measured
AA-IFBench67.6%measured
BBH99.5%estimated ± 2.8 pp, medium confidence
FailureSensorIQ64.0%estimated ± 5.0 pp, medium confidence
GPQA87.8%measured
MMLU85.0%estimated ± 0.9 pp, high confidence
Vals GPQA Diamond83.3%estimated ± 3.2 pp, high confidence
Vals LiveCodeBench52.0%estimated ± 3.4 pp, low confidence
Vals MMLU-Pro85.8%estimated ± 2.3 pp, high confidence
MATH-50097.5%estimated ± 3.1 pp, medium confidence
MMMLU86.5%estimated ± 0.7 pp, medium confidence
MMMU82.9%measured
Chess Puzzles28.9%estimated ± 4.7 pp, medium confidence
AIME 202595.4%estimated ± 1.8 pp, medium confidence
AA MMLU-Pro84.0%estimated ± 0.8 pp, medium confidence
Gert Labs32.4%measured
AA Harvey LAB v1.081.0%estimated ± 1.2 pp, low confidence
AA Tau3 Banking27.5%estimated ± 3.7 pp, medium confidence
ApprenticeBench3.4%estimated ± 10.4 pp, low confidence
ARC-AGI-175.7%estimated ± 6.7 pp, medium confidence
ARC-AGI-239.2%estimated ± 10.9 pp, low confidence
BabaIsBench29.0%measured
CursorBench 3.126.3%estimated ± 3.4 pp, low confidence
CursorBench 3.247.6%estimated ± 3.6 pp, medium confidence
EBR-bench0.0%estimated ± 10.4 pp, low confidence
FrontierCode 1.1 Main22.6%estimated ± 4.2 pp, low confidence
FrontierMath v2 (Tier 4)5.7%estimated ± 4.0 pp, high confidence
FrontierMath v2 (Tiers 1-3)35.1%measured
FrontierSWE v24.4%estimated ± 8.3 pp, low confidence
Furniture Assembly32.9%estimated ± 9.3 pp, medium confidence
MaxxBench45.0%estimated ± 5.7 pp, low confidence
MazeBench0.1%estimated ± 2.7 pp, high confidence
Mystery Game Puzzles7.0%measured
NYT Connections65.0%estimated ± 12.1 pp, low confidence
OfficeQA Pro50.3%estimated ± 6.8 pp, low confidence
OSWorld-Verified73.2%estimated ± 3.8 pp, medium confidence
ParseBench-158.7%estimated ± 6.2 pp, medium confidence
Terminal-Bench Hard44.4%estimated ± 4.0 pp, high confidence
Vals SWE-bench70.0%measured
Terminal-Bench 2.1 (Vals AI)52.3%estimated ± 6.4 pp, medium confidence
CWE-Bench-AA41.9%estimated ± 8.1 pp, medium confidence
AA Cyber Index13.5%estimated ± 9.2 pp, low confidence
DeepsecBench-AA10.1%estimated ± 8.2 pp, low confidence
HealthBench Professional (length-adjusted, Artificial Analysis)52.3%estimated ± 4.3 pp, low confidence
HealthBench Professional (raw, Artificial Analysis)56.6%estimated ± 1.1 pp, low confidence
AA ITBench39.3%estimated ± 4.0 pp, high confidence
Bug Hunt Bench8.9%estimated ± 7.2 pp, low confidence
Chartography (tools)80.0%estimated ± 4.1 pp, low confidence
CursorBench 4.030.7%estimated ± 3.3 pp, medium confidence
CWE-bench v140.8%estimated ± 5.7 pp, medium confidence
DeepSWE56.3%estimated ± 7.2 pp, low confidence
DRACO71.9%estimated ± 2.0 pp, medium confidence
FrontierCode 2.019.5%estimated ± 6.7 pp, low confidence
FrontierPhysics1.3%estimated ± 4.7 pp, medium confidence
HLE w/o tools33.0%estimated ± 4.9 pp, high confidence
OSWorld 2.117.0%estimated ± 3.6 pp, medium confidence
OSWorld 2.1 Offline42.5%estimated ± 10.1 pp, low confidence
PostTrainBench v1.115.4%estimated ± 3.7 pp, medium confidence
SpireClimb0.0%estimated ± 9.3 pp, medium confidence
StealthMark32.4%measured
SWE Multilingual71.3%measured
Toolathlon-Verified48.3%estimated ± 2.3 pp, low confidence
VulcanBench Frontier v472.8%estimated ± 6.8 pp, low confidence
AA AutomationBench44.6%estimated ± 9.9 pp, low confidence
GDP.pdf14.3%estimated ± 4.2 pp, medium confidence
ARC-AGI-30.0%estimated ± 9.3 pp, low confidence
ARC-AGI-3 Provider Adapter2.7%estimated ± 7.3 pp, low confidence
cursorBench4144.8%estimated ± 3.7 pp, medium confidence
CWE-bench35.1%estimated ± 6.2 pp, low confidence
MKA33.0%estimated ± 4.6 pp, medium confidence
SkillsBench official leaderboard (BenchFlow)44.4%estimated ± 6.3 pp, low confidence
CompileBench55.6%estimated ± 10.0 pp, low confidence
Vibe Code Bench12.8%estimated ± 8.4 pp, medium confidence
FACTS Multimodal39.8%estimated ± 4.7 pp, high confidence
Hermes Bench55.1%estimated ± 2.9 pp, high confidence
Hermes Index21.9%estimated ± 5.7 pp, low confidence
ParseBench-266.0%estimated ± 5.0 pp, medium confidence
CharXiv78.4%measured
CharXiv w/o tools80.0%estimated ± 1.2 pp, high confidence
ExploitBench14.6%estimated ± 7.2 pp, low confidence
ExploitGym0.0%estimated ± 8.3 pp, low confidence
AI2D_TEST92.9%estimated ± 0.9 pp, medium confidence
C-Eval91.4%measured
Claw-Eval72.4%measured
CountBench97.8%measured
DeepPlanning25.3%estimated ± 11.8 pp, low confidence
DynaMath85.6%measured
ERQA62.5%measured
HMMT Feb 202593.8%measured
HMMT Feb 202684.3%measured
HMMT Nov 202590.7%measured
INCLUDE84.0%estimated ± 2.0 pp, medium confidence
MathVision84.9%estimated ± 3.0 pp, high confidence
MCP Atlas64.7%estimated ± 7.8 pp, low confidence
MLVU (M-Avg)86.6%measured
MMAnswerBench80.8%measured
MMLU-ProX83.7%estimated ± 1.3 pp, high confidence
MMLU-Redux93.5%measured
MMMU-Pro75.8%measured
NL2Repo36.2%measured
OmniDocBench 1.590.3%estimated ± 1.5 pp, medium confidence
PostTrainBench v112.0%estimated ± 3.6 pp, medium confidence
QwenClawBench53.4%measured
RealWorldQA84.1%measured
ScreenSpot Pro71.3%estimated ± 4.8 pp, medium confidence
SimpleVQA56.1%measured
SuperGPQA66.0%measured
Terminal-Bench 2.059.3%measured
Toolathlon40.5%estimated ± 6.3 pp, medium confidence
V*94.7%measured
Video-MME (w/o subtitle)82.9%estimated ± 1.2 pp, high confidence
Video-MME (with subtitle)87.7%measured
VideoMMMU84.4%measured
We-Math82.1%estimated ± 2.1 pp, medium confidence
AA LiveCodeBench86.6%estimated ± 2.6 pp, high confidence
HealthBench Hard0.0%estimated ± 5.1 pp, low confidence
LiveCodeBench Pro78.4%estimated ± 6.0 pp, low confidence
MedXpertQA (MM)65.1%estimated ± 2.4 pp, high confidence
MMLU-Pro (Arcee)81.3%estimated ± 4.0 pp, medium confidence
React Native Evals78.4%estimated ± 2.7 pp, medium confidence
ResearchClawBench19.5%estimated ± 1.3 pp, high confidence
SWE-Rebench60.2%estimated ± 3.6 pp, medium confidence
PostTrainBench12.9%estimated ± 3.7 pp, medium confidence
DAYJOB0.0%estimated ± 3.2 pp, medium confidence
DAYJOB Healthcare0.7%estimated ± 4.2 pp, high confidence
Finance Agent v255.1%estimated ± 2.4 pp, low confidence
BioMysteryBench (human-solvable)81.7%estimated ± 0.6 pp, low confidence
FrontierCode 1.1 Extended53.7%estimated ± 3.0 pp, low confidence
HealthBench (raw)31.4%estimated ± 6.0 pp, low confidence
HealthBench (length-adjusted)47.2%estimated ± 3.4 pp, low confidence
HealthBench Professional46.8%estimated ± 4.2 pp, low confidence
HealthBench Professional (raw)43.1%estimated ± 4.5 pp, medium confidence
HLE-Verified15.1%estimated ± 7.1 pp, low confidence
ScarfBench24.9%estimated ± 9.1 pp, low confidence
BlenderWorld (text-only)70.0%estimated ± 2.8 pp, low confidence
Cookie-Bench76.9%estimated ± 1.3 pp, low confidence
STEMBench2.3%estimated ± 0.2 pp, low confidence
SimpleQA17.6%estimated ± 4.3 pp, medium confidence
LiveCodeBench77.6%estimated ± 14.6 pp, low confidence
Agents' Last Exam29.7%estimated ± 9.7 pp, low confidence
BabyVision w/ Python88.8%estimated ± 3.8 pp, low confidence
OpenHarmony Bench v1.051.0%estimated ± 2.4 pp, medium confidence
SEC-Bench Pro37.0%estimated ± 9.3 pp, low confidence
IMOAnswerBench80.1%estimated ± 5.6 pp, medium confidence
BabyVision55.6%estimated ± 9.1 pp, low confidence
MMVU75.8%estimated ± 2.7 pp, medium confidence
PerceptionBench58.5%estimated ± 4.9 pp, low confidence
MRCRv285.3%estimated ± 11.3 pp, low confidence
CC-OCR81.2%measured
MMLongBench-Doc61.3%estimated ± 2.6 pp, low confidence
RefCOCO (avg)92.5%measured
OCRBench V270.6%estimated ± 2.1 pp, medium confidence
BioBasicsBench33.9%estimated ± 2.8 pp, low confidence
LifeVal10.6%estimated ± 5.0 pp, low confidence
MMMU-Pro w/ Python77.9%estimated ± 2.0 pp, high confidence
ExploitBench Internal Port0.0%estimated ± 5.2 pp, low confidence