Inference under Covariate-Adaptive Randomization

Federico Bugni, Ivan Canay and Azeem Shaikh

No CWP21/16, CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies

Abstract: This paper studies inference for the average treatment eff ect in randomized controlled trials with covariate-adaptive randomization. Here, by covariate-adaptive randomization, we mean randomization schemes that first stratify according to baseline covariates and then assign treatment status so as to achieve "balance" within each stratum. Such schemes include, for example, Efron's biased-coin design and strati ed block randomization. When testing the null hypothesis that the average treatment eff ect equals a pre-speci fied value in such settings, we fi rst show that the usual two-sample t-test is conservative in the sense that it has limiting rejection probability under the null hypothesis no greater than and typically strictly less than the nominal level. In a simulation study, we fi nd that the rejection probability may in fact be dramatically less than the nominal level. We show further that these same conclusions remain true for a naïve permutation test, but that a modi fied version of the permutation test yields a test that is non-conservative in the sense that its limiting rejection probability under the null hypothesis equals the nominal level for a wide variety of randomization schemes. The modi fied version of the permutation test has the additional advantage that it has rejection probability exactly equal to the nominal level for some distributions satisfying the null hypothesis and some randomization schemes. Finally, we show that the usual t-test (on the coefficient on treatment assignment) in a linear regression of outcomes on treatment assignment and indicators for each of the strata yields a non-conservative test as well under even weaker assumptions on the randomization scheme. In a simulation study, we fi nd that the non-conservative tests have substantially greater power than the usual two-sample t-test.

Keywords: Covariate-adaptive randomization; strati ed block randomization; Efron's biased-coin design; treatment assignment; randomized controlled trial; permutation test; two-sample t-test; strata xed e ects (search for similar items in EconPapers)
JEL-codes: C12 C14 (search for similar items in EconPapers)
Date: 2016-05-10
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (9)

Downloads: (external link)
http://www.ifs.org.uk/uploads/cemmap/wps/cwp211616.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (http://www.ifs.org.uk/uploads/cemmap/wps/cwp211616.pdf [301 Moved Permanently]--> https://www.ifs.org.uk/uploads/cemmap/wps/cwp211616.pdf [302 Found]--> https://ifs.org.uk/uploads/cemmap/wps/cwp211616.pdf)

Related works:
Journal Article: Inference Under Covariate-Adaptive Randomization (2018)
Working Paper: Inference under covariate-adaptive randomization (2017)
Working Paper: Inference under covariate-adaptive randomization (2017)
Working Paper: Inference under Covariate-Adaptive Randomization (2016)
Working Paper: Inference under covariate-adaptive randomization (2015)
Working Paper: Inference under covariate-adaptive randomization (2015)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ifs:cemmap:21/16

Ordering information: This working paper can be ordered from
The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

Access Statistics for this paper

More papers in CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE. Contact information at EDIRC.
Bibliographic data for series maintained by Emma Hyman ().