Visual Inference and Graphical Representation in Regression Discontinuity Designs

Christina Korting, Carl Lieberman, Jordan Matsudaira, Zhuan Pei and Yi Shen
Additional contact information
Christina Korting: Cornell University
Jordan Matsudaira: Columbia University
Yi Shen: University of Waterloo

Working Papers from Princeton University, Department of Economics, Industrial Relations Section.

Abstract: Despite the widespread use of graphs in empirical research, little is known about readers' ability to process the statistical information they are meant to convey ("visual inference"). In this paper, we evaluate several key aspects of visual inference in regression discontinuity (RD) designs by measuring how well readers can identify discontinuities in graphs. First, we assess the effects of graphical representation methods on visual inference, using randomized experiments crowdsourcing discontinuity classifications with graphs produced from data generating processes calibrated on datasets from 11 published papers. Second, we evaluate visual inference by both experts and non-experts and study experts’ ability to predict our experimental results. We find that experts perform comparably to non-experts and partly anticipate the effects of graphical methods. Third, we compare experts’ visual inference to commonly used econometric procedures in RD designs and observe that it achieves similar or lower type I error rates. Fourth, we conduct an eyetracking study to further understand RD visual inference, but it does not reveal gaze patterns that robustly predict successful inference. We also evaluate visual inference in the closely related regression kink design.

Keywords: Regression Discontinuity Design; Regression Kink Design; Graphical Methods; VisualInference; Eyetracking; Expert Prediction (search for similar items in EconPapers)
JEL-codes: C10 (search for similar items in EconPapers)
Date: 2020-02
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://dataspace.princeton.edu/bitstream/88435/dsp013j3335157/3/638.pdf
Our link check indicates that this URL is bad, the error code is: 500 Internal Server Error

Related works:
Journal Article: Visual Inference and Graphical Representation in Regression Discontinuity Designs (2023)
Working Paper: Visual Inference and Graphical Representation in Regression Discontinuity Designs (2023)
Working Paper: Visual Inference and Graphical Representation in Regression Discontinuity Designs (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pri:indrel:638

Access Statistics for this paper

More papers in Working Papers from Princeton University, Department of Economics, Industrial Relations Section. Contact information at EDIRC.
Bibliographic data for series maintained by Bobray Bordelon ().