Comparing distributions by multiple testing across quantiles or CDF values

Matt Goldman and David Kaplan

Journal of Econometrics, 2018, vol. 206, issue 1, 143-166

Abstract: We first show that one-sample and two-sample Kolmogorov–Smirnov tests may be interpreted as multiple testing procedures, nonparametrically testing equality at each point in the distribution with strong control of the finite-sample familywise error rate. Second, we provide an alternative procedure that distributes power across the distribution more evenly than the Kolmogorov–Smirnov test, which suffers low sensitivity to tail deviations. Third, we provide a formula for near-instant one-sample computation. Fourth, we improve power with stepdown and pre-test procedures. Finally, we extend our results to conditional distributions and regression discontinuity designs. Simulations, empirical examples, and code are provided.

Keywords: Dirichlet; Familywise error rate; Kolmogorov–Smirnov; Probability integral transform; Regression discontinuity (search for similar items in EconPapers)
JEL-codes: C21 (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (25)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0304407618300812
Full text for ScienceDirect subscribers only

Related works:
Working Paper: Comparing distributions by multiple testing across quantiles (2018)
Working Paper: Comparing distributions by multiple testing across quantiles or CDF values (2018)
Working Paper: Comparing distributions by multiple testing across quantiles or CDF values (2018)
Working Paper: Comparing distributions by multiple testing across quantiles or CDF values (2017)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:econom:v:206:y:2018:i:1:p:143-166

DOI: 10.1016/j.jeconom.2018.04.003

Access Statistics for this article

Journal of Econometrics is currently edited by T. Amemiya, A. R. Gallant, J. F. Geweke, C. Hsiao and P. M. Robinson

More articles in Journal of Econometrics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().