Seminar No. 227

Title: Visual Inference and Graphical Representation in Regression Discontinuity Designs

Speaker: Zhuan Pei, Cornell University

Time: May 29, 2020 9:00-10:30   (GMT+8:00)

Venue: Online 

About the speaker:

Zhuan Pei is an assistant professor in the Department of Policy Analysis and Management at Cornell University and is currently a visiting assistant professor of economics at Princeton University. He is a labor economist who studies the effects and designs of social and employment programs and related empirical methods.

Abstract:

Despite the widespread use of graphs in empirical research, little is known about readers’ ability to process the statistical information they are meant to convey (“visual inference”). In this paper, we evaluate several key aspects of visual inference in regression discontinuity (RD) designs by measuring how well readers can identify discontinuities in graphs. First, we assess the effects of graphical representation methods on visual inference, using randomized experiments crowdsourcing discontinuity classifications with graphs produced from data generating processes calibrated on datasets from 11 published papers. Second, we evaluate visual inference by both experts and non-experts and study experts’ ability to predict our experimental results. We find that experts perform comparably to non-experts and partly anticipate the effects of graphical methods. Third, we compare experts' visual inference to commonly used econometric procedures in RD designs and observe that it achieves similar or lower type I error rates. Fourth, we conduct an eyetracking study to further understand RD visual inference, but it does not reveal gaze patterns that robustly predict successful inference. We also evaluate visual inference in the closely related regression kink design.