Calibration
ZeroBench → PerceptionBench
PerceptionBench is estimated from ZeroBench with a offset logistic curve fitted on 5 models measured on both: y = 0.5545 + (0.6830 − 0.5545) / (1 + exp(−169.73·(x − 0.2369))), R² = 0.94, cross-validated error 2.7 pp. It is used for 6 estimates.
| Estimated model | ZeroBench | PerceptionBench | Source |
|---|---|---|---|
| Muse Spark Open | 50.0% | 68.3% | estimated ± 2.7 pp, low confidence |
| GPT-5.4 | 41.0% | 68.3% | estimated ± 2.7 pp, low confidence |
| Muse Spark | 33.0% | 68.3% | estimated ± 2.7 pp, medium confidence |
| Gemini 3.1 Pro | 29.0% | 68.3% | estimated ± 2.7 pp, medium confidence |
| Seed 2.1 Pro | 18.0% | 55.5% | estimated ± 2.7 pp, medium confidence |
| Seed 2.1 Turbo | 11.0% | 55.5% | estimated ± 2.7 pp, low confidence |
Fitted on
| Model | ZeroBench | PerceptionBench |
|---|---|---|
| dots3-note Preview | 19.0% | 53.4% |
| Inkling 2 Mini | 17.0% | 57.5% |
| Kimi K3.1 Pro | 39.0% | 68.3% |
| Kimi K3 | 23.0% | 58.5% |
| Qwen3.8 Max | 24.0% | 63.5% |