A hierarchical modelling framework for identifying unusual performance in health care providers

David I. Ohlssen, Linda D. Sharples and David J. Spiegelhalter

Journal of the Royal Statistical Society Series A, 2007, vol. 170, issue 4, 865-890

Abstract: A wide variety of statistical methods have been proposed for detecting unusual performance in cross‐sectional data on health care providers. We attempt to create a unified framework for comparing these methods, focusing on a clear distinction between estimation and hypothesis testing approaches, with the corresponding distinction between detecting ‘extreme’ and ‘divergent’ performance. When assuming a random‐effects model the random‐effects distribution forms the null hypothesis, and there appears little point in testing whether individual effects are greater or less than average. The hypothesis testing approach uses p‐values as summaries and brings with it the standard problems of multiple testing, whether Bayesian or classical inference is adopted. A null random‐effects formulation allows us to answer appropriate questions of the type: ‘is a particular provider worse than we would expect the true worst provider (but still part of the null distribution) to be'? We outline a broad three‐stage strategy of exploratory detection of unusual providers, detailed modelling robust to potential outliers and confirmation of unusual performance, illustrated by using two detailed examples. The concepts are most easily handled within a Bayesian analytic framework using Markov chain Monte Carlo methods, but the basic ideas should be generally applicable.

Date: 2007
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://doi.org/10.1111/j.1467-985X.2007.00487.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssa:v:170:y:2007:i:4:p:865-890

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-985X

Access Statistics for this article

Journal of the Royal Statistical Society Series A is currently edited by A. Chevalier and L. Sharples

More articles in Journal of the Royal Statistical Society Series A from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().