EconPapers    
Economics at your fingertips  
 

Bayes Factor Design Analysis: Planning for compelling evidence

Felix D. Schönbrodt and Eric-Jan Wagenmakers
Additional contact information
Felix D. Schönbrodt: Ludwig-Maximilians-Universität München
Eric-Jan Wagenmakers: University of Amsterdam

No d4dcu_v1, OSF Preprints from Center for Open Science

Abstract: A sizeable literature exists on the use of frequentist power analysis in the null-hypothesis significance testing (NHST) paradigm to facilitate the design of informative experiments. In contrast, there is almost no literature that discusses the design of experiments when Bayes factors (BFs) are used as a measure of evidence. Here we explore Bayes Factor Design Analysis (BFDA) as a useful tool to design studies for maximum efficiency and informativeness. We elaborate on three possible BF designs, (a) a fixed-n design, (b) an open-ended Sequential Bayes Factor (SBF) design, where researchers can test after each participant and can stop data collection whenever there is strong evidence for either H1 or H0, and (c) a modified SBF design that defines a maximal sample size where data collection is stopped regardless of the current state of evidence. We demonstrate how the properties of each design (i.e., expected strength of evi- dence, expected sample size, expected probability of misleading evidence, expected probability of weak evidence) can be evaluated using Monte Carlo simulations and equip researchers with the necessary information to compute their own Bayesian design analyses.

Date: 2016-10-25
References: Add references at CitEc
Citations:

Downloads: (external link)
https://osf.io/download/580fa18db83f6901ddc945e9/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:d4dcu_v1

DOI: 10.31219/osf.io/d4dcu_v1

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().

 
Page updated 2025-04-05
Handle: RePEc:osf:osfxxx:d4dcu_v1