Bias in meta‐analysis due to outcome variable selection within studies

J. L. Hutton and Paula R. Williamson

Journal of the Royal Statistical Society Series C, 2000, vol. 49, issue 3, 359-370

Abstract: Although bias in meta‐analysis arising from selective publication has been studied, within‐study selection has received little attention. Chronic diseases often have several possible outcome variables. Methods based on the size of the effect allow results from studies with different outcomes to be combined. However, the possibility of selective reporting of outcomes must be considered. The effect of selective reporting on estimates of the size of the effect and significance levels is presented, and sensitivity analyses are suggested. Substantial publication bias could arise from multiple testing of outcomes in a study, followed by selective reporting. Two meta‐analyses, on anthelminth therapy and a treatment for incontinence, are reassessed allowing for within‐study selection, as it is clear that more outcomes had been measured than were reported. The sensitivity analyses show that the robustness of the anthelminth results is dependent on what assumption one makes about the reporting strategy for the largest trial. The possible influence of correlation between within‐child measurements was such that the conclusions could easily be reversed. The effect of a mild assumption on within‐trial selection alone could alter general recommendations about the treatment for incontinence.

Date: 2000
References: Add references at CitEc
Citations: View citations in EconPapers (17)

Downloads: (external link)
https://doi.org/10.1111/1467-9876.00197

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssc:v:49:y:2000:i:3:p:359-370

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9876

Access Statistics for this article

Journal of the Royal Statistical Society Series C is currently edited by R. Chandler and P. W. F. Smith

More articles in Journal of the Royal Statistical Society Series C from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().