EconPapers    
Economics at your fingertips  
 

Statistical Power of Within and Between-Subjects Designs in Economic Experiments

Charles Bellemare (), Luc Bissonnette and Sabine Kröger ()

Cahiers de recherche from CIRPEE

Abstract: This paper discusses the choice of the number of participants for within-subjects (WS) designs and between-subjects (BS) designs based on simulations of statistical power allowing for different numbers of experimental periods. We illustrate the usefulness of the approach in the context of field experiments on gift exchange. Our results suggest that a BS design requires between 4 to 8 times more subjects than a WS design to reach an acceptable level of statistical power. Moreover, the predicted minimal sample sizes required to correctly detect a treatment effect with a probability of 80% greatly exceed sizes currently used in the literature. Our results suggest that adding experimental periods in an experiment can substantially increase the statistical power of a WS design, but have very little effect on the statistical power of the BS design. Finally, we discuss issues relating to numerical computation and present the powerBBK package programmed for STATA. This package allows users to conduct their own analysis of power for the different designs (WS and BS), conditional on user specified experimental parameters (true effect size, sample size, number of periods, noise levels for control and treatment, error distributions), statistical tests (parametric and nonparametric), and estimation methods (linear regression, binary choice models (probit and logit), censored regression models (tobit)).

Keywords: Within-subjects design; Between-subjects design; sample sizes; statistical power; experiments (search for similar items in EconPapers)
JEL-codes: C8 C9 D03 (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (10) Track citations by RSS feed

Downloads: (external link)
http://www.cirpee.org/fileadmin/documents/Cahiers_2014/CIRPEE14-25.pdf (application/pdf)

Related works:
Working Paper: Statistical Power of Within and Between-Subjects Designs in Economic Experiments (2014) Downloads
Working Paper: Statistical Power of Within and Between-Subjects Designs in Economic Experiments (2014) Downloads
Working Paper: Statistical Power of Within and Between-Subjects Designs in Economic Experiments (2014) Downloads
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:lvl:lacicr:1425

Access Statistics for this paper

More papers in Cahiers de recherche from CIRPEE Contact information at EDIRC.
Bibliographic data for series maintained by Manuel Paradis ().

 
Page updated 2024-02-27
Handle: RePEc:lvl:lacicr:1425