# SimpleQA → AA-Omniscience Accuracy

Calibration · https://benchgap.net/calibration/1426 · data retrieved 2026-10-29

AA-Omniscience Accuracy is estimated from SimpleQA with a Michaelis–Menten curve fitted on 7 models measured on both: y = 0.4561·x / (0.19959 + x), R² = 0.86, cross-validated error 2.7 pp. It is used for 4 estimates.

| Estimated model | SimpleQA | AA-Omniscience Accuracy | Source |
|---|---|---|---|
| [Grok 3 [Beta]](https://benchgap.net/model/grok-3-beta.md) | 43.6% | 31.3% | estimated ± 2.7 pp, low confidence |
| [DeepSeek-R1-0528](https://benchgap.net/model/deepseek-r1-0528.md) | 27.8% | 26.5% | estimated ± 2.7 pp, medium confidence |
| [Gemini 2.0 Flash-Lite](https://benchgap.net/model/gemini-2-0-flash-lite.md) | 16.5% | 20.6% | estimated ± 2.7 pp, medium confidence |
| [Gemini 1.5 Flash](https://benchgap.net/model/gemini-1-5-flash.md) | 8.6% | 13.7% | estimated ± 2.7 pp, low confidence |

## Fitted on

| Model | SimpleQA | AA-Omniscience Accuracy |
|---|---|---|
| [DeepSeek-R1](https://benchgap.net/model/deepseek-r1.md) | 30.1% | 30.5% |
| [DeepSeek V3](https://benchgap.net/model/deepseek-v3.md) | 24.9% | 25.5% |
| [Gemini 2.0 Flash](https://benchgap.net/model/gemini-2-0-flash.md) | 29.9% | 23.5% |
| [Gemini 2.5 Flash-Lite](https://benchgap.net/model/gemini-2-5-flash-lite.md) | 10.7% | 15.4% |
| [Kimi K2](https://benchgap.net/model/kimi-k2.md) | 31.0% | 27.4% |
| [Mistral Small 3.1](https://benchgap.net/model/mistral-small-3-1.md) | 10.4% | 15.1% |
| [o4-mini](https://benchgap.net/model/o4-mini.md) | 20.2% | 24.8% |