The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding

Jason Brown, Dayton Lambert and Timothy Wojan

No RWP 18-4, Research Working Paper from Federal Reserve Bank of Kansas City

Abstract: This article suggests two methods for deriving a statistical verdict from a null finding,allowing economists to more confidently conclude when ?not significant\" can in fact be interpreted as ?no substantive effect.\" The proposed methodology can be extended to a variety of empirical contexts where size and power matter. The example used to demonstrate the method is the Economic Research Service's 2004 Report to Congress that was charged with statistically identifying any unintended negative employment consequences of the Conservation Reserve Program (the Program). The report failed to identify a statistically significant negative long-term effect of the Program on employment growth, but the authors correctly cautioned that the verdict of ?no negative employment effect\" was only valid if the econometric test was statistically powerful. We replicate the 2004 analysis and use new methods of statistical inference to resolve the two critical deficiencies that preclude estimation of statistical power by economists: 1) positing a compelling effect size, and 2) providing an estimate of the variability of an unobserved alternative distribution using simulation methods. We conclude that the test used in the report had high power for detecting employment effects of -1 percent or lower resulting from the Program, equivalent to job losses reducing a conservative estimate of environmental benefits by a third.

Keywords: Power analysis; Monte Carlo simulation; Hypothesis testing (search for similar items in EconPapers)
JEL-codes: C12 Q42 R11 (search for similar items in EconPapers)
Pages: 28 pages
Date: 2018-05-01
New Economics Papers: this item is included in nep-ecm and nep-env
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.kansascityfed.org/documents/674/The_Ef ... ving_a_Statistic.pdf (application/pdf)

Related works:
Journal Article: The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding (2019)
Working Paper: The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding (2017)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fip:fedkrw:rwp18-04

Ordering information: This working paper can be ordered from

Access Statistics for this paper

More papers in Research Working Paper from Federal Reserve Bank of Kansas City Contact information at EDIRC.
Bibliographic data for series maintained by Zach Kastens ().