Controlling the familywise error rate with plug‐in estimator for the proportion of true null hypotheses

Helmut Finner and Veronika Gontscharuk

Journal of the Royal Statistical Society Series B, 2009, vol. 71, issue 5, 1031-1048

Abstract: Summary. Estimation of the number or proportion of true null hypotheses in multiple‐testing problems has become an interesting area of research. The first important work in this field was performed by Schweder and Spjøtvoll. Among others, they proposed to use plug‐in estimates for the proportion of true null hypotheses in multiple‐test procedures to improve the power. We investigate the problem of controlling the familywise error rate FWER when such estimators are used as plug‐in estimators in single‐step or step‐down multiple‐test procedures. First we investigate the case of independent p‐values under the null hypotheses and show that a suitable choice of plug‐in estimates leads to control of FWER in single‐step procedures. We also investigate the power and study the asymptotic behaviour of the number of false rejections. Although step‐down procedures are more difficult to handle we briefly consider a possible solution to this problem. Anyhow, plug‐in step‐down procedures are not recommended here. For dependent p‐values we derive a condition for asymptotic control of FWER and provide some simulations with respect to FWER and power for various models and hypotheses.

Date: 2009
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (9)

Downloads: (external link)
https://doi.org/10.1111/j.1467-9868.2009.00719.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:71:y:2009:i:5:p:1031-1048

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().