Controlling the familywise error rate with plug-in estimator for the proportion of true null hypotheses

Helmut Finner and Veronika Gontscharuk

Journal Of The Royal Statistical Society Series B, 2009, vol. 71, issue 5, pages 1031-1048

Abstract: Estimation of the number or proportion of true null hypotheses in multiple-testing problems has become an interesting area of research. The first important work in this field was performed by Schweder and Spjøtvoll. Among others, they proposed to use plug-in estimates for the proportion of true null hypotheses in multiple-test procedures to improve the power. We investigate the problem of controlling the familywise error rate FWER when such estimators are used as plug-in estimators in single-step or step-down multiple-test procedures. First we investigate the case of independent "p"-values under the null hypotheses and show that a suitable choice of plug-in estimates leads to control of FWER in single-step procedures. We also investigate the power and study the asymptotic behaviour of the number of false rejections. Although step-down procedures are more difficult to handle we briefly consider a possible solution to this problem. Anyhow, plug-in step-down procedures are not recommended here. For dependent "p"-values we derive a condition for asymptotic control of FWER and provide some simulations with respect to FWER and power for various models and hypotheses. Copyright (c) 2009 Royal Statistical Society.

Date: 2009

Downloads: (external link)
http://www.blackwell-synergy.com/doi/abs/10.1111/j.1467-9868.2009.00719.x link to full text (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: http://EconPapers.repec.org/RePEc:bla:jorssb:v:71:y:2009:i:5:p:1031-1048

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=1369-7412

Access Statistics for this article

Journal Of The Royal Statistical Society Series B is edited by C. Robert and A. T. A. Wood

More articles in Journal Of The Royal Statistical Society Series B from Royal Statistical Society
Series data maintained by Christopher F. Baum ().