Regulator Loss Functions and Hierarchical Modeling for Safety Decision Making

Laura A. Hatfield, Christine M. Baugh, Vanessa Azzone and Sharon-Lise T. Normand

Medical Decision Making, 2017, vol. 37, issue 5, 512-522

Abstract: Background . Regulators must act to protect the public when evidence indicates safety problems with medical devices. This requires complex tradeoffs among risks and benefits, which conventional safety surveillance methods do not incorporate. Objective . To combine explicit regulator loss functions with statistical evidence on medical device safety signals to improve decision making. Methods . In the Hospital Cost and Utilization Project National Inpatient Sample, we select pediatric inpatient admissions and identify adverse medical device events (AMDEs). We fit hierarchical Bayesian models to the annual hospital-level AMDE rates, accounting for patient and hospital characteristics. These models produce expected AMDE rates (a safety target), against which we compare the observed rates in a test year to compute a safety signal. We specify a set of loss functions that quantify the costs and benefits of each action as a function of the safety signal. We integrate the loss functions over the posterior distribution of the safety signal to obtain the posterior (Bayes) risk; the preferred action has the smallest Bayes risk. Using simulation and an analysis of AMDE data, we compare our minimum-risk decisions to a conventional Z score approach for classifying safety signals. Results . The 2 rules produced different actions for nearly half of hospitals (45%). In the simulation, decisions that minimize Bayes risk outperform Z score–based decisions, even when the loss functions or hierarchical models are misspecified. Limitations . Our method is sensitive to the choice of loss functions; eliciting quantitative inputs to the loss functions from regulators is challenging. Conclusions . A decision-theoretic approach to acting on safety signals is potentially promising but requires careful specification of loss functions in consultation with subject matter experts.

Keywords: decision analysis; simulation methods; Bayesian statistical methods; hierarchical models; database analysis; performance measures (search for similar items in EconPapers)
Date: 2017
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X16686767 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:37:y:2017:i:5:p:512-522

DOI: 10.1177/0272989X16686767

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().