Other · model
BTL-3 benchmark scores
As of 2026-11-21, BTL-3 (Other) has measured scores on 2 benchmarks and estimated scores on 11 more.
| Benchmark | Score | Source |
|---|---|---|
| AA-SciCode | 46.4% | estimated ± 4.7 pp, high confidence |
| GDPval-AA | 38.6% | estimated ± 5.5 pp, low confidence |
| LiveCodeBench v6 | 88.1% | measured |
| SciCode | 49.3% | estimated ± 4.9 pp, high confidence |
| τ²-bench results | 100.0% | estimated ± 12.4 pp, low confidence |
| AA Coding Index | 57.9% | estimated ± 5.7 pp, medium confidence |
| SWE-bench Verified | 73.5% | estimated ± 9.7 pp, low confidence |
| BFCL v4 | 88.5% | measured |
| SWE-bench Pro | 55.6% | estimated ± 6.0 pp, medium confidence |
| Vals LiveCodeBench | 86.1% | estimated ± 3.4 pp, medium confidence |
| MCP Atlas | 75.5% | estimated ± 14.2 pp, low confidence |
| NL2Repo | 41.1% | estimated ± 3.4 pp, high confidence |
| PinchBench | 100.0% | estimated ± 5.0 pp, low confidence |