The Choice of a Noninformative Prior on Between-Study Variance Strongly Affects Predictions of Future Treatment Effect

Olga Gajic-Veljanoski, Angela M. Cheung, Ahmed M. Bayoumi and George Tomlinson

Medical Decision Making, 2013, vol. 33, issue 3, 356-368

Abstract: Purpose. Bayesian random-effects meta-analyses require the analyst to specify the prior distribution for between-study variance of the treatment effect. We assessed the sensitivity of prediction and other outputs of the meta-analysis to the choice of this prior. Methods. We reanalyzed 7 published meta-analyses (5–14 trials) with rare (event rates 50%). We examined 10 noninformative priors: inverse gamma on between-study variance ( τ 2 ), 2 uniforms on each of the between-study standard deviation ( τ ) and τ 2 , uniform shrinkage on τ 2 , DuMouchel shrinkage on τ, half-normal on τ 2 , and half-normal priors on τ with large and small variances. For each analysis, we calculated the posterior distributions for τ, the population treatment effect in current studies, and the predicted treatment effect in a future study. We assessed goodness of fit using total residual deviance, the deviance information criterion, and predictive deviance (by cross-validations). Results. According to total residual deviance, the best-fitting priors were uniform on τ 2 . According to predictive deviance, half-normal on τ 2 and the shrinkage priors were optimal. Across analyses with the 10 priors, there were no important differences in the posteriors for the population treatment effect, but there were substantial differences in the posteriors for τ and predictions. The priors that fitted best according to predictive deviance resulted in less uncertainty around predictions of future treatment effect. Conclusions. In this sample of Bayesian meta-analyses with binary outcomes, the choice of noninformative prior for between-study variance affected model fit and the predictions of future treatment effect. When the predictive distribution is of interest, we highly recommend examination of multiple prior distributions for between-study variance, especially the half-normal on τ 2 and the shrinkage priors.

Keywords: noninformative priors; between-study variance; goodness-of-fit; predictions; random-effects meta-analysis; Bayesian methods (search for similar items in EconPapers)
Date: 2013
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0272989X12453504 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:medema:v:33:y:2013:i:3:p:356-368

DOI: 10.1177/0272989X12453504

Access Statistics for this article

More articles in Medical Decision Making
Bibliographic data for series maintained by SAGE Publications ().