Work Comparative Regression Discontinuity and Regression Discontinuity as Alternatives to RCT for Estimating Average Treatment Effects

Duncan Chaplin, Charles Tilley, Denise Hoffman and John T. Jones

Working Papers, Center for Retirement Research at Boston College from Center for Retirement Research

Abstract: In this paper we use data from an evaluation of the Benefit Offset National Demonstration (BOND) to evaluate the efficacy of using comparative regression discontinuity (CRD) and regression discontinuity (RD) relative to a randomized controlled trial (RCT). BOND is a large demonstration intended to promote return to work among people with disabilities who receive Social Security Disability Insurance (DI). RD is known as a relatively rigorous non-experimental method but produces imprecise results that apply to small populations. CRD is a promising enhancement that addresses these issues. The CRD and RD methods are potentially attractive because they can be used in contexts in which RCTs are challenging or infeasible. However, the bias of findings from CRD and RD studies is unknown in the context of DI. In this paper, we estimate CRD and RD models using simulated assignment to the BOND treatment group based on the duration of DI receipt at the start of BOND. We compare the CRD and RD estimates to RCT estimates. While the findings are not intended to revise the well-established evidence evaluating BOND, they can be used to help interpret the results from CRD and RD studies on other income support interventions for people with disabilities and to inform future study designs. Our paper has two key limitations. First, our RD models are far from ideal. This limits the degree to which our RD results generalize to what would be found with state-of-the art RD models. Second, our results may not generalize to other populations. Our analysis was based on BOND beneficiaries who were representative of the larger DI population at the time of BOND random assignment but may not reflect the DI population in more recent years.

Pages: 63 pages
Date: 2022-08
New Economics Papers: this item is included in nep-exp and nep-hea
References: Add references at CitEc
Citations:

Downloads: (external link)
https://crr.bc.edu/working-papers/comparative-regr ... offset-national-d-2/ R
Our link check indicates that this URL is bad, the error code is: 404 Not Found

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:crr:crrwps:wp2022-07

Access Statistics for this paper

More papers in Working Papers, Center for Retirement Research at Boston College from Center for Retirement Research Contact information at EDIRC.
Bibliographic data for series maintained by Amy Grzybowski () and Christopher F Baum ().