benchgap
Calibration

OSWorld 2.0 → MCP Atlas

MCP Atlas is estimated from OSWorld 2.0 with a Michaelis–Menten curve fitted on 8 models measured on both: y = 0.8455·x / (0.00856 + x), R² = 0.40, cross-validated error 10.4 pp. It is used for 1 estimate.

Estimated modelOSWorld 2.0MCP AtlasSource
Claude Opus 4.713.9%79.6%estimated ± 10.4 pp, low confidence