The Romano–Wolf multiple-hypothesis correction in Stata
Damian Clarke (),
Joseph P. Romano () and
Michael Wolf ()
Additional contact information
Joseph P. Romano: Stanford University
Stata Journal, 2020, vol. 20, issue 4, 812-843
When considering multiple-hypothesis tests simultaneously, standard statistical techniques will lead to overrejection of null hypotheses unless the multi- plicity of the testing framework is explicitly considered. In this article, we discuss the Romano–Wolf multiple-hypothesis correction and document its implementa- tion in Stata. The Romano–Wolf correction (asymptotically) controls the fami- lywise error rate, that is, the probability of rejecting at least one true null hy- pothesis among a family of hypotheses under test. This correction is considerably more powerful than earlier multiple-testing procedures, such as the Bonferroni and Holm corrections, given that it takes into account the dependence structure of the test statistics by resampling from the original data. We describe a command, rwolf, that implements this correction and provide several examples based on a wide range of models. We document and discuss the performance gains from us- ing rwolf over other multiple-testing procedures that control the familywise error rate.
Keywords: rwolf; bootstrap; familywise error rate; multiple-hypothesis testing; permutation methods; rwolf; stepdown procedure (search for similar items in EconPapers)
Note: to access software from within Stata, net describe http://www.stata-journal.com/software/sj20-4/st0618/
References: Add references at CitEc
Citations: View citations in EconPapers (12) Track citations by RSS feed
Downloads: (external link)
http://www.stata-journal.com/article.html?article=st0618 link to article purchase
Working Paper: The Romano-Wolf Multiple Hypothesis Correction in Stata (2019)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:tsj:stataj:v:20:y:2020:i:4:p:812-843
Ordering information: This journal article can be ordered from
Access Statistics for this article
Stata Journal is currently edited by H. Joseph Newton and Nicholas J. Cox
More articles in Stata Journal from StataCorp LP
Bibliographic data for series maintained by Christopher F. Baum () and Lisa Gilmore ().