A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019)

Tian Jiarui (Alex) ()
Additional contact information
Tian Jiarui (Alex): Department of Economics and Finance, University of Canterbury, Christchurch, New Zealand

Economics - The Open-Access, Open-Assessment Journal, 2023, vol. 17, issue 1, 7

Abstract: This study replicates the paper “Brown, J. P., Lambert, D. M., & Wojan, T. R. (2019). The effect of the conservation reserve program on rural economies: deriving a statistical verdict from a null finding. American Journal of Agricultural Economics, 101(2), 528–540” and their procedure for calculating the so-called ex post power of statistical tests of significance for regression coefficients. There appears no generally accepted method for calculating ex post power, and Brown, Lambert, and Wojan (BLW) provided a bootstrapping method that can be applied after the parameter of interest is estimated. They recommend researchers to use this procedure to investigate whether a statistically insignificant finding is likely to be due to a low power property of the significance test. This study makes two main contributions. First, it verifies whether the data and code that BLW provided are reliable to reproduce their results. Second, it constructs Monte Carlo experiments to assess the performance of BLW’s method. The results indicate that their method produces ex post power estimates that are relatively close to the true power values. Mean power estimates are generally unbiased, and 95% of the estimates lie within +/− 5% points of the true power. In conclusion, my replication provides further evidence of the reliability of BLW’s method.

Keywords: ex post power; statistical insignificance; Monte Carlo experiments; bootstrapping; replication (search for similar items in EconPapers)
JEL-codes: C12 C15 C18 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1515/econ-2022-0036 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:econoa:v:17:y:2023:i:1:p:7:n:1

DOI: 10.1515/econ-2022-0036

Access Statistics for this article

Economics - The Open-Access, Open-Assessment Journal is currently edited by Katharine Rockett

More articles in Economics - The Open-Access, Open-Assessment Journal from De Gruyter
Bibliographic data for series maintained by Peter Golla ().