A direct approach to false discovery rates

John D. Storey

Journal of the Royal Statistical Society Series B, 2002, vol. 64, issue 3, 479-498

Abstract: Summary. Multiple‐hypothesis testing involves guarding against much more complicated errors than single‐hypothesis testing. Whereas we typically control the type I error rate for a single‐hypothesis test, a compound error rate is controlled for multiple‐hypothesis tests. For example, controlling the false discovery rate FDR traditionally involves intricate sequential p‐value rejection methods based on the observed data. Whereas a sequential p‐value method fixes the error rate and estimates its corresponding rejection region, we propose the opposite approach—we fix the rejection region and then estimate its corresponding error rate. This new approach offers increased applicability, accuracy and power. We apply the methodology to both the positive false discovery rate pFDR and FDR, and provide evidence for its benefits. It is shown that pFDR is probably the quantity of interest over FDR. Also discussed is the calculation of the q‐value, the pFDR analogue of the p‐value, which eliminates the need to set the error rate beforehand as is traditionally done. Some simple numerical examples are presented that show that this new approach can yield an increase of over eight times in power compared with the Benjamini–Hochberg FDR method.

Date: 2002
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (282)

Downloads: (external link)
https://doi.org/10.1111/1467-9868.00346

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:64:y:2002:i:3:p:479-498

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().