Individually randomized group treatment trials: A critical appraisal of frequently used design and analytic approaches

S.L. Pals, D.M. Murray, C.M. Alfano, W.R. Shadish, P.J. Hannan and W.L. Baker

American Journal of Public Health, 2008, vol. 98, issue 8, 1418-1424

Abstract: Objectives. We reviewed published individually randomized group treatment (IRGT) trials to assess researchers' awareness of within-group correlation and determine whether appropriate design and analytic methods were used to test for treatment effectiveness. Methods. We assessed sample size and analytic methods in IRGT trials published in 6 public health and behavioral health journals between 2002 and 2006. Results. Our review included 34 articles; in 32 (94.1%) of these articles, inappropriate analytic methods were used. In only 1 article did the researchers claim that expected intraclass correlations (ICCs) were taken into account in sample size estimation; in most articles, sample size was not mentioned or ICCs were ignored in the reported calculations. Conclusions. Trials in which individuals are randomly assigned to study conditions and treatments administered in groups may induce within-group correlation, violating the assumption of independence underlying commonly used statistical methods. Methods that take expected ICCs into account should be used in reexamining past studies and planning future studies to ensure that interventions are not judged effective solely on the basis of statistical artifacts. We strongly encourage investigators to report ICCs from IRGT trials and describe study characteristics clearly to aid these efforts.

Date: 2008
References: Add references at CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://hdl.handle.net/10.2105/AJPH.2007.127027

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aph:ajpbhl:10.2105/ajph.2007.127027_8

DOI: 10.2105/AJPH.2007.127027

Access Statistics for this article

American Journal of Public Health is currently edited by Alfredo Morabia

More articles in American Journal of Public Health from American Public Health Association
Bibliographic data for series maintained by Christopher F Baum ().