A forward search algorithm for detecting extreme study effects in network meta-analysis

Maria Petropoulou, Georgia Salanti, Gerta Rücker, Guido Schwarzer, Irini Moustaki and Dimitris Mavridis

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: In a quantitative synthesis of studies via meta-analysis, it is possible that some studies provide a markedly different relative treatment effect or have a large impact on the summary estimate and/or heterogeneity. Extreme study effects (outliers) can be detected visually with forest/funnel plots and by using statistical outlying detection methods. A forward search (FS) algorithm is a common outlying diagnostic tool recently extended to meta-analysis. FS starts by fitting the assumed model to a subset of the data which is gradually incremented by adding the remaining studies according to their closeness to the postulated data-generating model. At each step of the algorithm, parameter estimates, measures of fit (residuals, likelihood contributions), and test statistics are being monitored and their sharp changes are used as an indication for outliers. In this article, we extend the FS algorithm to network meta-analysis (NMA). In NMA, visualization of outliers is more challenging due to the multivariate nature of the data and the fact that studies contribute both directly and indirectly to the network estimates. Outliers are expected to contribute not only to heterogeneity but also to inconsistency, compromising the NMA results. The FS algorithm was applied to real and artificial networks of interventions that include outliers. We developed an R package (NMAoutlier) to allow replication and dissemination of the proposed method. We conclude that the FS algorithm is a visual diagnostic tool that helps to identify studies that are a potential source of heterogeneity and inconsistency.

Keywords: forward search; Cook’s distance; NMAoutlier; outliers; network meta-analysis (search for similar items in EconPapers)
JEL-codes: C1 (search for similar items in EconPapers)
Pages: 15 pages
Date: 2021-11-10
New Economics Papers: this item is included in nep-isf and nep-ore
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in Statistics in Medicine, 10, November, 2021, 40(25), pp. 5642 - 5656. ISSN: 0277-6715

Downloads: (external link)
http://eprints.lse.ac.uk/110954/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:110954

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager ().