Properties of restricted randomization with implications for experimental design

Nordin Mattias () and Schultzberg Mårten ()
Additional contact information
Nordin Mattias: Department of Statistics, Uppsala Center for Fiscal Studies (UCFS) and Urban Lab, Uppsala University, Uppsala, Sweden
Schultzberg Mårten: Spotify and Department of Statistics, Uppsala University, Uppsala, Sweden

Journal of Causal Inference, 2022, vol. 10, issue 1, 227-245

Abstract: Recently, there has been increasing interest in the use of heavily restricted randomization designs which enforce balance on observed covariates in randomized controlled trials. However, when restrictions are strict, there is a risk that the treatment effect estimator will have a very high mean squared error (MSE). In this article, we formalize this risk and propose a novel combinatoric-based approach to describe and address this issue. First, we validate our new approach by re-proving some known properties of complete randomization and restricted randomization. Second, we propose a novel diagnostic measure for restricted designs that only use the information embedded in the combinatorics of the design. Third, we show that the variance of the MSE of the difference-in-means estimator in a randomized experiment is a linear function of this diagnostic measure. Finally, we identify situations in which restricted designs can lead to an increased risk of getting a high MSE and discuss how our diagnostic measure can be used to detect such designs. Our results have implications for any restricted randomization design and can be used to evaluate the trade-off between enforcing balance on observed covariates and avoiding too restrictive designs.

Keywords: experimental design; restricted randomization; rerandomization; computationally intensive methods (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1515/jci-2021-0057 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:causin:v:10:y:2022:i:1:p:227-245:n:11

DOI: 10.1515/jci-2021-0057

Access Statistics for this article

Journal of Causal Inference is currently edited by Elias Bareinboim, Jin Tian and Iván Díaz

More articles in Journal of Causal Inference from De Gruyter
Bibliographic data for series maintained by Peter Golla ().