Developing a template matching algorithm for benchmarking hospital performance in a diverse, integrated healthcare system

Medicine (Baltimore). 2020 Jun 12;99(24):e20385. doi: 10.1097/MD.0000000000020385.

Abstract

Template matching is a proposed approach for hospital benchmarking, which measures performance based on matching a subset of comparable patient hospitalizations from each hospital. We assessed the ability to create the required matched samples and thus the feasibility of template matching to benchmark hospital performance in a diverse healthcare system.Nationwide Veterans Affairs (VA) hospitals, 2017.Observational cohort study.We used administrative and clinical data from 668,592 hospitalizations at 134 VA hospitals in 2017. A standardized template of 300 hospitalizations was selected, and then 300 hospitalizations were matched to the template from each hospital.There was substantial case-mix variation across VA hospitals, which persisted after excluding small hospitals, hospitals with primarily psychiatric admissions, and hospitalizations for rare diagnoses. Median age ranged from 57 to 75 years across hospitals; percent surgical admissions ranged from 0.0% to 21.0%; percent of admissions through the emergency department, 0.1% to 98.7%; and percent Hispanic patients, 0.2% to 93.3%. Characteristics for which there was substantial variation across hospitals could not be balanced with any matching algorithm tested. Although most other variables could be balanced, we were unable to identify a matching algorithm that balanced more than ∼20 variables simultaneously.We were unable to identify a template matching approach that could balance hospitals on all measured characteristics potentially important to benchmarking. Given the magnitude of case-mix variation across VA hospitals, a single template is likely not feasible for general hospital benchmarking.

Publication types

  • Observational Study

MeSH terms

  • Aged
  • Algorithms
  • Benchmarking / methods*
  • Benchmarking / standards
  • Cohort Studies
  • Delivery of Health Care, Integrated / statistics & numerical data*
  • Diagnosis-Related Groups / trends
  • Emergency Service, Hospital / statistics & numerical data
  • Feasibility Studies
  • Female
  • Hispanic or Latino / statistics & numerical data
  • Hospitalization / statistics & numerical data*
  • Hospitalization / trends
  • Hospitals, Veterans / statistics & numerical data*
  • Humans
  • Male
  • Middle Aged
  • Mortality / trends
  • Outcome Assessment, Health Care / methods
  • Quality of Health Care / statistics & numerical data
  • Surgery Department, Hospital / statistics & numerical data
  • United States / epidemiology
  • United States Department of Veterans Affairs / organization & administration