Researchers' degrees of flexibility: Revisiting COVID‐19 policy evaluations

Joakim A. Weill, Matthieu Stigler, Olivier Deschenes and Michael R. Springborn

Economic Inquiry, 2025, vol. 63, issue 2, 441-462

Abstract: Empirical research involves multiple, seemingly‐minor choices that can substantially impact a study's findings. While acknowledged, the importance of these “degrees of flexibility” on published estimates is not well understood. We examine the considerable literature focused on the impacts of early COVID‐19 policies on social distancing to assess the role of researchers' degrees of flexibility on the estimated effects of mobility‐reducing policies. We find that estimates reported in previous studies are not robust to minor changes in typically‐unexplored dimensions of the degree of flexibility space, and usual robustness tests systematically fail to detect these issues.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/ecin.13273

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:ecinqu:v:63:y:2025:i:2:p:441-462

Ordering information: This journal article can be ordered from
https://ordering.onl ... s.aspx?ref=1465-7295

Access Statistics for this article

Economic Inquiry is currently edited by Tim Salmon

More articles in Economic Inquiry from Western Economic Association International Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().