benchgap
Calibration

ScreenSpot Pro → ParseBench

ParseBench is estimated from ScreenSpot Pro with a Michaelis–Menten + offset curve fitted on 6 models measured on both: y = 0.0127 + 2.0000·x / (1.91088 + x), R² = 0.66, cross-validated error 5.5 pp. It is used for 4 estimates.

Estimated modelScreenSpot ProParseBenchSource
Holo2-235B-A22B70.6%55.2%estimated ± 5.5 pp, low confidence
Holo2-30B-A3B66.1%52.7%estimated ± 5.5 pp, low confidence
Holo2-8B58.9%48.4%estimated ± 5.5 pp, low confidence
Holo2-4B57.2%47.3%estimated ± 5.5 pp, low confidence

Fitted on

ModelScreenSpot ProParseBench
Claude Opus 4.683.1%54.1%
Claude Opus 4.887.9%62.3%
Gemini 3.1 Pro84.4%69.1%
GPT-5.485.4%62.2%
GPT-6 Astra92.7%69.9%
Nemotron 3 Nano Omni 30B A3B57.8%48.5%