Fast computation of exact confidence intervals for randomized experiments with binary outcomes

P.M. Aronow, Haoge Chang and Patrick Lopatto

Journal of Econometrics, 2025, vol. 251, issue C

Abstract: Given a randomized experiment with binary outcomes, exact confidence intervals for the average causal effect of the treatment can be computed through a series of permutation tests. This approach requires minimal assumptions and is valid for all sample sizes, as it does not rely on large-sample approximations such as those implied by the central limit theorem. We show that these confidence intervals can be found in O(nlogn) permutation tests in the case of balanced designs, where the treatment and control groups have equal sizes, and O(n2) permutation tests in the general case. Prior to this work, the most efficient known constructions required O(n2) such tests in the balanced case (Li and Ding, 2016), and O(n4) tests in the general case (Rigdon and Hudgens, 2015). Our results thus facilitate exact inference as a viable option for randomized experiments far larger than those accessible by previous methods. We also generalize our construction to produce confidence intervals for other causal estimands, including the relative risk ratio and odds ratio, yielding similar computational gains.

Keywords: Confidence interval; Design-based inference; Permutation test (search for similar items in EconPapers)
JEL-codes: C12 C63 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0304407625001101
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:econom:v:251:y:2025:i:c:s0304407625001101

DOI: 10.1016/j.jeconom.2025.106056

Access Statistics for this article

Journal of Econometrics is currently edited by T. Amemiya, A. R. Gallant, J. F. Geweke, C. Hsiao and P. M. Robinson

More articles in Journal of Econometrics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().