Visual Inference and Graphical Representation in Regression Discontinuity Designs

Christina Korting, Carl Lieberman, Jordan Matsudaira, Zhuan Pei and Yi Shen

The Quarterly Journal of Economics, 2023, vol. 138, issue 3, 1977-2019

Abstract: Despite the widespread use of graphs in empirical research, little is known about readers’ ability to process the statistical information they are meant to convey (“visual inference”). We study visual inference in the context of regression discontinuity (RD) designs by measuring how accurately readers identify discontinuities in graphs produced from data-generating processes calibrated on 11 published papers from leading economics journals. First, we assess the effects of different graphical representation methods on visual inference using randomized experiments. We find that bin widths and fit lines have the largest effects on whether participants correctly perceive the presence or absence of a discontinuity. Our experimental results allow us to make evidence-based recommendations to practitioners, and we suggest using small bins with no fit lines as a starting point to construct RD graphs. Second, we compare visual inference on graphs constructed using our preferred method with widely used econometric inference procedures. We find that visual inference achieves similar or lower type I error (false positive) rates and complements econometric inference.

Date: 2023
References: Add references at CitEc
Citations: View citations in EconPapers (9)

Downloads: (external link)
http://hdl.handle.net/10.1093/qje/qjad011 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Visual Inference and Graphical Representation in Regression Discontinuity Designs (2023)
Working Paper: Visual Inference and Graphical Representation in Regression Discontinuity Designs (2021)
Working Paper: Visual Inference and Graphical Representation in Regression Discontinuity Designs (2020)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:qjecon:v:138:y:2023:i:3:p:1977-2019.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

The Quarterly Journal of Economics is currently edited by Robert J. Barro, Lawrence F. Katz, Nathan Nunn, Andrei Shleifer and Stefanie Stantcheva

More articles in The Quarterly Journal of Economics from President and Fellows of Harvard College
Bibliographic data for series maintained by Oxford University Press ().