Accuracy in Parameter Estimation and Simulation Approaches for Sample Size Planning with Multiple Stimuli

Erin Michelle Buchanan, Mahmoud Medhat Elsherif, Jason Geller, Chris Aberson, Necdet Gurkan, Ettore Ambrosini, Tom Heyman, Maria Montefinese, Wolf Vanpaemel and Krystian Barzykowski
Additional contact information
Erin Michelle Buchanan: Harrisburg University of Science and Technology
Mahmoud Medhat Elsherif: Leicester University
Jason Geller: University of Iowa
Ettore Ambrosini: University of Padua
Tom Heyman: Leiden University
Maria Montefinese: University College London

No e3afx, OSF Preprints from Center for Open Science

Abstract: The planning of sample size for research studies often focuses on obtaining a significant result given a specified level of power, significance, and an anticipated effect size. This planning requires prior knowledge of the study design and a statistical analysis to calculate the proposed sample size. However, there may not be one specific testable analysis from which to derive power [@silberzahn2018many] or a hypothesis to test for the project (e.g., creation of a stimuli database). Modern power and sample size planning suggestions include accuracy in parameter estimation [AIPE, @kelley2007; @maxwell2008] and simulation of proposed analyses [@chalmers2020]. These toolkits provide flexibility in traditional power analyses that focus on the if-this, then-that approach, yet, both AIPE and simulation require either a specific parameter (e.g., mean, effect size, etc.) or statistical test for planning sample size. In this tutorial, we explore how AIPE and simulation approaches can be combined to accommodate studies that may not have a specific hypothesis test or wish to account for the potential of a multiverse of analyses. Specifically, we focus on studies that use multiple items and suggest that sample sizes can be planned to measure those items adequately and precisely, regardless of statistical test. This tutorial also provides multiple code vignettes and package functionality that researchers can adapt and apply to their own measures.

Date: 2023-12-29
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://osf.io/download/658e2b812a656050e20bf227/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:e3afx

DOI: 10.31219/osf.io/e3afx

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().