benchgap
Other · model

BTL-3 benchmark scores

As of 2026-11-21, BTL-3 (Other) has measured scores on 2 benchmarks and estimated scores on 11 more.

BenchmarkScoreSource
AA-SciCode46.4%estimated ± 4.7 pp, high confidence
GDPval-AA38.6%estimated ± 5.5 pp, low confidence
LiveCodeBench v688.1%measured
SciCode49.3%estimated ± 4.9 pp, high confidence
τ²-bench results100.0%estimated ± 12.4 pp, low confidence
AA Coding Index57.9%estimated ± 5.7 pp, medium confidence
SWE-bench Verified73.5%estimated ± 9.7 pp, low confidence
BFCL v488.5%measured
SWE-bench Pro55.6%estimated ± 6.0 pp, medium confidence
Vals LiveCodeBench86.1%estimated ± 3.4 pp, medium confidence
MCP Atlas75.5%estimated ± 14.2 pp, low confidence
NL2Repo41.1%estimated ± 3.4 pp, high confidence
PinchBench100.0%estimated ± 5.0 pp, low confidence