Calibration
Toolathlon-Verified → BrowseComp
BrowseComp is estimated from Toolathlon-Verified with a Hill curve fitted on 10 models measured on both: y = 0.0000 + (0.8972 − 0.0000)·x^4.63 / (0.36879^4.63 + x^4.63), R² = 0.79, cross-validated error 6.4 pp. It is used for 1 estimate.
| Estimated model | Toolathlon-Verified | BrowseComp | Source |
|---|---|---|---|
| Laguna S 2.1 | 49.7% | 71.7% | estimated ± 6.4 pp, medium confidence |
Fitted on
| Model | Toolathlon-Verified | BrowseComp |
|---|---|---|
| Claude Opus 5 | 80.6% | 90.8% |
| DeepSeek V4 Flash 0731 | 70.3% | 73.2% |
| DeepSeek V4 Pro 0813 | 74.1% | 83.4% |
| dots3-note Preview | 55.6% | 83.3% |
| Inkling-Small | 54.4% | 77.4% |
| Kimi K3 | 73.2% | 91.2% |
| Ornith-1.5-35B-A3B | 48.7% | 67.6% |
| Ornith-1.5-397B | 71.2% | 86.6% |
| Ornith-1.5-9B | 41.2% | 56.4% |
| Step 5 Preview | 74.1% | 88.7% |