Bias and Bias Correction in Multisite Instrumental Variables Analysis of Heterogeneous Mediator Effects

Sean F. Reardon, Fatih Unlu, Pei Zhu and Howard S. Bloom
Additional contact information
Sean F. Reardon: Stanford University
Fatih Unlu: Abt Associates
Howard S. Bloom: MDRC

Journal of Educational and Behavioral Statistics, 2014, vol. 39, issue 1, 53-86

Abstract: We explore the use of instrumental variables (IV) analysis with a multisite randomized trial to estimate the effect of a mediating variable on an outcome in cases where it can be assumed that the observed mediator is the only mechanism linking treatment assignment to outcomes, an assumption known in the IV literature as the exclusion restriction. We use a random-coefficient IV model that allows both the impact of program assignment on the mediator (compliance with assignment) and the impact of the mediator on the outcome (the mediator effect) to vary across sites and to covary with one another. This extension of conventional fixed-coefficient IV analysis illuminates a potential bias in IV analysis which Reardon and Raudenbush refer to as “compliance-effect covariance bias.†We first derive an expression for this bias and then use simulations to investigate the sampling variance of the conventional fixed-coefficient two-stage least squares (2SLS) estimator in the presence of varying (and covarying) compliance and treatment effects. We next develop two alternate IV estimators that are less susceptible to compliance-effect covariance bias. We compare the bias, sampling variance, and root mean squared error of these “bias-corrected IV estimators†to those of 2SLS and ordinary least squares (OLS). We find that, when the first-stage F -statistic exceeds 10 (a commonly used threshold for instrument strength), the bias-corrected estimators typically perform better than 2SLS or OLS. In the last part of the article, we use both the new estimators and 2SLS to reanalyze data from two large multisite studies.

Keywords: mediator effect; instrumental variables; multisite trials (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/1076998613512525 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:39:y:2014:i:1:p:53-86

DOI: 10.3102/1076998613512525

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().