Optimizing the use of simulation methods in multilevel sample size calculations

William John Browne, Christopher Michael John Charlton, Toni Price, George Leckie and Fiona Steele

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: Simulation-based methods are an alternative approach to sample size calculations, particularly for complex multilevel models where analytical calculations may be less straightforward. A criticism of simulation-based approaches is that they are computationally intensive, so in this paper we contrast different approaches of using the information within each simulation and sharing information across scenarios. We describe the “standard error” method (using the known effect estimate and simulations to estimate the standard error for a scenario) and show that it requires far fewer simulations than other methods. We also show that transforming power calculations onto different scales results in linear relationships with a particular family of functions of the sample size to be optimized, resulting in an easy route to sharing information across scenarios.

Keywords: sample size calculations; multilevel models; simulation methods; power (search for similar items in EconPapers)
JEL-codes: C1 (search for similar items in EconPapers)
Date: 2025-07-17
References: Add references at CitEc
Citations:

Published in Journal of Educational and Behavioral Statistics, 17, July, 2025. ISSN: 1076-9986

Downloads: (external link)
http://eprints.lse.ac.uk/128881/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:128881

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager ().