Statistical Power of Within and Between-Subjects Designs in Economic Experiments

Charles Bellemare (), Luc Bissonnette and Sabine Kröger ()

No 8583, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: This paper discusses the choice of the number of participants for within-subjects (WS) designs and between-subjects (BS) designs based on simulations of statistical power allowing for different numbers of experimental periods. We illustrate the usefulness of the approach in the context of field experiments on gift exchange. Our results suggest that a BS design requires between 4 to 8 times more subjects than a WS design to reach an acceptable level of statistical power. Moreover, the predicted minimal sample sizes required to correctly detect a treatment effect with a probability of 80% greatly exceed sizes currently used in the literature. Our results suggest that adding experimental periods in an experiment can substantially increase the statistical power of a WS design, but have very little effect on the statistical power of the BS design. Finally, we discuss issues relating to numerical computation and present the powerBBK package programmed for STATA. This package allows users to conduct their own analysis of power for the different designs (WS and BS), conditional on user specified experimental parameters (true effect size, sample size, number of periods, noise levels for control and treatment, error distributions), statistical tests (parametric and nonparametric), and estimation methods (linear regression, binary choice models (probit and logit), censored regression models (tobit)).

Keywords: within-subjects design; between-subjects design; sample sizes; statistical power; experiments (search for similar items in EconPapers)
JEL-codes: C8 C9 D03 (search for similar items in EconPapers)
Pages: 26 pages
Date: 2014-10
New Economics Papers: this item is included in nep-cbe, nep-ecm and nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (14)

Downloads: (external link)
https://docs.iza.org/dp8583.pdf (application/pdf)

Related works:
Working Paper: Statistical Power of Within and Between-Subjects Designs in Economic Experiments (2014)
Working Paper: Statistical Power of Within and Between-Subjects Designs in Economic Experiments (2014)
Working Paper: Statistical Power of Within and Between-Subjects Designs in Economic Experiments (2014)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp8583

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().