Toward an Understanding of the Political Economy of Using Field Experiments in Policymaking

Guglielmo Briscese and John List

No 33239, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: Field experiments provide the clearest window into the true impact of many policies, allowing us to understand what works, what does not, and why. Yet, their widespread use has not been accompanied by a deep understanding of the political economy of their adoption in policy circles. This study begins with a large-scale natural field experiment that demonstrates the ineffectiveness of a widely implemented intervention. We leverage this result to understand how policymakers and a representative sample of the U.S. population update their beliefs of not only the policy itself, but the use of science and the trust they have in government. Policymakers, initially overly optimistic about the program’s effectiveness, adjust their views based on evidence but show reduced demand for experimentation, suggesting experiment aversion when results defy expectations. Among the U.S. public, support for policy experiments is high and remains robust despite receiving disappointing results, though trust in the implementing institutions declines, particularly in terms of perceptions of competence and integrity. Providing additional information on the value of learning from unexpected findings partially mitigates this trust loss. These insights, from both the demand and supply side, reveal the complexities of managing policymakers’ expectations and underscore the potential returns to educating the public on the value of open-mindedness in policy experimentation.

JEL-codes: C9 C93 H4 H41 O12 O36 P1 (search for similar items in EconPapers)
Date: 2024-12
New Economics Papers: this item is included in nep-exp, nep-ltv, nep-pol and nep-upt
Note: DEV ED EEE PE PR
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.nber.org/papers/w33239.pdf (application/pdf)
Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html. Free access is also available to older working papers.

Related works:
Working Paper: Toward an Understanding of the Political Economy of Using Field Experiments in Policymaking (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:33239

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w33239
The price is Paper copy available by mail.

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().