On the Use of Design-Based Simulations

Bruno Ferman

Papers from arXiv.org

Abstract: Design-based simulations hold outcomes fixed and generate variation by resampling treatment assignment or shocks. They can be used in both methodological and applied work to assess inference procedures. However, their informativeness for these uses is not straightforward. We show that, when treatment effects are nonzero, these simulations can be misleading about spatial or serial correlation in clustered experiments, difference-in-differences, and shift-share designs. We analyze alternatives and formalize how these simulations can reveal features of the error distribution despite holding outcomes fixed. Finally, we consider limitations in the use of design-based simulations to select among different inference methods in applied work.

Date: 2026-03, Revised 2026-10
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://arxiv.org/pdf/2603.11381 Latest version (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:arx:papers:2603.11381

Access Statistics for this paper

More papers in Papers from arXiv.org
Bibliographic data for series maintained by arXiv administrators ().