Power to the researchers: Calculating power after estimation

Jiarui Tian, Tom Coupé, Sayak Khatua, W. Reed () and Benjamin D. K. Wood

Review of Development Economics, 2025, vol. 29, issue 1, 324-358

Abstract: This study demonstrates a simple and reliable method for calculating ex post power. We first conduct a series of Monte Carlo experiments to assess its performance. The experiments are designed to produce artificial datasets that resemble actual data from 23 studies funded by the International Initiative for Impact Evaluation (3ie). After determining that the method performs adequately, we then apply it to the 23 studies and compare their ex post power with the ex‐ante power claimed on their funding applications. We find the average ex post power of the 3ie studies is close to 80%. However, there are more estimates of low power than would be expected if all studies had 80% true power. Most of the differences between ex post and ex ante power can be explained by differences between planned and actual total observations, number of clusters, and the degree of intracluster correlation. This demonstrates how ex post power can be used by funders to evaluate previously funded research and identify areas for improved power estimation in future research. We further show how ex post power can aid in the interpretation of both insignificant and significant estimates.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/rode.13130

Related works:
Working Paper: Power to the Researchers: Calculating Power After Estimation (2022)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:rdevec:v:29:y:2025:i:1:p:324-358

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=1363-6669

Access Statistics for this article

Review of Development Economics is currently edited by E. Kwan Choi

More articles in Review of Development Economics from Wiley Blackwell
Bibliographic data for series maintained by Wiley Content Delivery ().