# Vals MMLU-Pro → AA MMLU-Pro

Calibration · https://benchgap.net/calibration/vals-mmlu-pro/current/to/aa-mmlu-pro/current · data retrieved 2026-11-18

AA MMLU-Pro is estimated from Vals MMLU-Pro with a Michaelis–Menten + offset curve fitted on 10 models measured on both: y = 0.2649 + 2.0000·x / (1.97410 + x), R² = 0.68, cross-validated error 1.1 pp. It is used for 13 estimates.

| Estimated model | Vals MMLU-Pro | AA MMLU-Pro | Source |
|---|---|---|---|
| [Gemini 3.1 Pro](https://benchgap.net/model/gemini-3-1-pro.md) | 91.0% | 89.6% | estimated ± 1.1 pp, medium confidence |
| [Qwen3.8 Max](https://benchgap.net/model/qwen3-8-max.md) | 88.6% | 88.4% | estimated ± 1.1 pp, high confidence |
| [Claude Sonnet 4.5 Thinking](https://benchgap.net/model/claude-sonnet-4-5-thinking.md) | 87.4% | 87.9% | estimated ± 1.1 pp, high confidence |
| [Grok 4.20](https://benchgap.net/model/grok-4-20-beta.md) | 86.3% | 87.3% | estimated ± 1.1 pp, high confidence |
| [Gemini 3.1 Flash-Lite](https://benchgap.net/model/gemini-3-1-flash-lite.md) | 86.2% | 87.3% | estimated ± 1.1 pp, high confidence |
| [GLM-5.3-Flash](https://benchgap.net/model/glm-5-3-flash.md) | 86.1% | 87.2% | estimated ± 1.1 pp, high confidence |
| [Qwen3.5 Flash](https://benchgap.net/model/qwen3-5-flash.md) | 84.1% | 86.2% | estimated ± 1.1 pp, high confidence |
| [MiMo-V2.5](https://benchgap.net/model/mimo-v2-5.md) | 82.9% | 85.6% | estimated ± 1.1 pp, high confidence |
| [GLM-4.5](https://benchgap.net/model/glm-4-5.md) | 81.2% | 84.8% | estimated ± 1.1 pp, high confidence |
| [Claude Haiku 4.5](https://benchgap.net/model/claude-haiku-4-5.md) | 78.7% | 83.5% | estimated ± 1.1 pp, medium confidence |
| [o3-mini](https://benchgap.net/model/o3-mini.md) | 78.7% | 83.5% | estimated ± 1.1 pp, medium confidence |
| [Claude 3.5 Sonnet](https://benchgap.net/model/claude-3-5-sonnet.md) | 78.4% | 83.3% | estimated ± 1.1 pp, medium confidence |
| [Gemini 1.5 Pro](https://benchgap.net/model/gemini-1-5-pro.md) | 75.3% | 81.7% | estimated ± 1.1 pp, medium confidence |

## Fitted on

| Model | Vals MMLU-Pro | AA MMLU-Pro |
|---|---|---|
| [Claude Opus 4.5 Thinking](https://benchgap.net/model/claude-opus-4-5-thinking.md) | 87.3% | 89.5% |
| [Gemini 3 Pro](https://benchgap.net/model/gemini-3-pro.md) | 90.1% | 89.8% |
| [GLM-4.7](https://benchgap.net/model/glm-4-7.md) | 82.7% | 85.6% |
| [GPT-5](https://benchgap.net/model/gpt-5.md) | 86.5% | 87.1% |
| [GPT-5.1](https://benchgap.net/model/gpt-5-1.md) | 86.4% | 87.0% |
| [GPT-5.2](https://benchgap.net/model/gpt-5-2.md) | 86.2% | 87.4% |
| [Grok 4](https://benchgap.net/model/grok-4.md) | 85.3% | 86.6% |
| [Grok 4.1 Fast (Reasoning)](https://benchgap.net/model/grok-4-1-fast-reasoning.md) | 84.2% | 85.4% |
| [Grok 4 Fast (Reasoning)](https://benchgap.net/model/grok-4-fast-reasoning.md) | 79.7% | 85.0% |
| [o3](https://benchgap.net/model/o3.md) | 85.6% | 85.3% |
