Discriminating Quality of Hospital Care in the United States

Sharon-Lise T. Normand, Robert E. Wolf and Barbara J. McNeil
Additional contact information
Sharon-Lise T. Normand: Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts, sharon@hcp.med.harvard.edu
Robert E. Wolf: Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts, Department of Biostatistics, Harvard School of Public Health, Boston, Massachusetts
Barbara J. McNeil: Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts, Department of Radiology, Brig-ham and Women's Hospital, Boston, Massachusetts

Medical Decision Making, 2008, vol. 28, issue 3, 308-322

Abstract: Background and objective. The Centers for Medicare and Medicaid Services (CMS) report quality of care for patients hospitalized with acute myocardial infarction (AMI), congestive heart failure (CHF), and community-acquired pneumonia (CAP) with the intention of rewarding superior performing hospitals. The aim of the study was to compare identification of superior hospitals for providing financial rewards using 2 different scoring systems: a latent score that weights individual clinical performance measures according to how well each discriminated hospital quality and a raw sum score (the system adopted by CMS). Methods. This observational cohort study used 2761 acute care hospitals in the United States reporting AMI clinical performance measures, 3271 reporting CHF measures, and 3714 hospitals reporting CAP measures. For each clinical condition, the main outcome measures included the average raw sum score, the latent score estimated from an item response theory (IRT) model, and the percentage of false negative superior designations made on the basis of raw sum scores relative to latent scores. Results. The average raw sum score was highest for AMI (88.8%) and lower for CHF (73.1%) and CAP (76.3%). AMI measures were equally nondiscriminating of hospital quality; hospital discharge instruction was most discriminating of CHF quality; pneumococcal vaccination was most discriminating of CAP quality. False negative rates varied 2-fold: AMI (10%), CHF (16%), and CAP (24%). Conclusions. Neither the AMI raw sum score nor latent score discriminates hospital quality due to ceiling effects. Current methods for aggregating measures result in different hospital superior designations than those based on the latent score. Organizations that financially reward hospitals on the basis of such scores need to assess predictive validity of scores and determine a minimum level of classification accuracy.

Keywords: performance measurement; composite measure; item response theory; latent variable; false negative and positive rates. (search for similar items in EconPapers)
Date: 2008
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X07312710 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:28:y:2008:i:3:p:308-322

DOI: 10.1177/0272989X07312710

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().