Stepwise Multiple Testing as Formalized Data Snooping

Joseph P. Romano and Michael Wolf

Econometrica, 2005, vol. 73, issue 4, 1237-1282

Abstract: In econometric applications, often several hypothesis tests are carried out at once. The problem then becomes how to decide which hypotheses to reject, accounting for the multitude of tests. This paper suggests a stepwise multiple testing procedure that asymptotically controls the familywise error rate. Compared to related single-step methods, the procedure is more powerful and often will reject more false hypotheses. In addition, we advocate the use of studentization when feasible. Unlike some stepwise methods, the method implicitly captures the joint dependence structure of the test statistics, which results in increased ability to detect false hypotheses. The methodology is presented in the context of comparing several strategies to a common benchmark. However, our ideas can easily be extended to other contexts where multiple tests occur. Some simulation studies show the improvements of our methods over previous proposals. We also provide an application to a set of real data. Copyright The Econometric Society 2005.

Date: 2005
References: Add references at CitEc
Citations: View citations in EconPapers (578)

Downloads: (external link)
http://hdl.handle.net/10.1111/j.1468-0262.2005.00615.x link to full text (text/html)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Stepwise Multiple Testing as Formalized Data Snooping (2015)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ecm:emetrp:v:73:y:2005:i:4:p:1237-1282

Ordering information: This journal article can be ordered from
https://www.economet ... ordering-back-issues

Access Statistics for this article

Econometrica is currently edited by Guido Imbens

More articles in Econometrica from Econometric Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().