benchgap
Calibration

DRACO → Hermes Bench

Hermes Bench is estimated from DRACO with a Michaelis–Menten curve fitted on 5 models measured on both: y = 2.0000·x / (1.53899 + x), R² = 0.63, cross-validated error 6.4 pp. It is used for 1 estimate.

Estimated modelDRACOHermes BenchSource
ERNIE 5.5 Flash Preview84.9%71.1%estimated ± 6.4 pp, low confidence

Fitted on

ModelDRACOHermes Bench
Claude Opus 5.587.4%76.7%
Claude Sonnet 5.587.0%73.5%
Hy4 preview77.2%70.8%
Ling 3.0 Flash70.4%53.8%
Step 5 Preview83.3%69.2%