Calibration
SuperGPQA → AA-Omniscience Accuracy
AA-Omniscience Accuracy is estimated from SuperGPQA with a linear curve fitted on 16 models measured on both: y = 0.6667·x + -0.1931, R² = 0.68, cross-validated error 6.0 pp. It is used for 3 estimates.
| Estimated model | SuperGPQA | AA-Omniscience Accuracy | Source |
|---|---|---|---|
| Qwen3 235B 2507 | 62.6% | 22.4% | estimated ± 6.0 pp, medium confidence |
| Seed 2.1 Pro | 70.8% | 27.9% | estimated ± 6.0 pp, medium confidence |
| Seed 2.1 Turbo | 67.4% | 25.6% | estimated ± 6.0 pp, medium confidence |