Calibration
BrowseComp → AA Cyber Index
AA Cyber Index is estimated from BrowseComp with a Michaelis–Menten + offset curve fitted on 8 models measured on both: y = 0.0000 + 2.0000·x / (3.35358 + x), R² = 0.40, cross-validated error 13.5 pp. It is used for 21 estimates.
| Estimated model | BrowseComp | AA Cyber Index | Source |
|---|---|---|---|
| Inkling 2 Small | 90.2% | 42.4% | estimated ± 13.5 pp, low confidence |
| GPT-5.5 Pro | 90.1% | 42.4% | estimated ± 13.5 pp, low confidence |
| GPT-5.4 Pro | 89.3% | 42.1% | estimated ± 13.5 pp, low confidence |
| Claude Mythos 5 | 88.0% | 41.6% | estimated ± 13.5 pp, low confidence |
| Claude Opus 4.6 | 83.7% | 39.9% | estimated ± 13.5 pp, low confidence |
| GPT-5.4 | 82.7% | 39.6% | estimated ± 13.5 pp, low confidence |
| Nemotron 3.5 Super VL 120B A12B | 78.0% | 37.7% | estimated ± 13.5 pp, low confidence |
| Nemotron 3.5 Super VL 120B A12B NVFP4 | 77.5% | 37.5% | estimated ± 13.5 pp, low confidence |
| Nemotron 3.5 Bolt 74B-A9B BF16 | 70.0% | 34.5% | estimated ± 13.5 pp, low confidence |
| Qwen3.5 397B | 69.0% | 34.1% | estimated ± 13.5 pp, low confidence |
| Agents-A1-4B | 66.8% | 33.2% | estimated ± 13.5 pp, low confidence |
| Nemotron 3.5 Bolt 74B-A9B | 66.8% | 33.2% | estimated ± 13.5 pp, low confidence |
| GPT-5.2 | 65.8% | 32.8% | estimated ± 13.5 pp, low confidence |
| Qwen3.5-27B | 61.0% | 30.8% | estimated ± 13.5 pp, low confidence |
| Qwen3.5-35B-A3B | 61.0% | 30.8% | estimated ± 13.5 pp, low confidence |
| Kimi K2.5 | 60.6% | 30.6% | estimated ± 13.5 pp, low confidence |
| GLM-4.7 | 52.0% | 26.8% | estimated ± 13.5 pp, low confidence |
| Sarvam 105B | 49.5% | 25.7% | estimated ± 13.5 pp, low confidence |
| Solar Pro 4 | 49.2% | 25.6% | estimated ± 13.5 pp, low confidence |
| LongCat-Flash-Lite-Sparse | 48.6% | 25.3% | estimated ± 13.5 pp, low confidence |
| Sarvam 30B | 35.5% | 19.1% | estimated ± 13.5 pp, low confidence |
Fitted on
| Model | BrowseComp | AA Cyber Index |
|---|---|---|
| GPT-6 Astra | 91.5% | 33.4% |
| Kimi K3.1 Pro | 92.1% | 64.1% |
| Kimi K3 | 91.2% | 41.3% |
| MiniMax M3 | 83.5% | 22.4% |
| Mistral Large 4 | 84.5% | 50.9% |
| Nemotron 3 Ultra | 44.4% | 13.1% |
| Beam 1.0 501B-A23B | 76.8% | 33.7% |
| Step 5 Preview | 88.7% | 47.7% |