Calibration

SimpleVQA → MedXpertQA (MM)

Name: benchgap: LLM benchmark scores, measured and estimated
Creator: benchgap

MedXpertQA (MM) is estimated from SimpleVQA with a offset logistic curve fitted on 6 models measured on both: y = 0.6501 + (0.7777 − 0.6501) / (1 + exp(−151.54·(x − 0.5920))), R² = 0.64, cross-validated error 7.1 pp. It is used for 0 estimates.