A Double Application of the Benjamini-Hochberg Procedure for Testing Batched Hypotheses

Qingyun Cai () and Hock Peng Chan
Additional contact information
Qingyun Cai: Xiamen University
Hock Peng Chan: National University of Singapore

Methodology and Computing in Applied Probability, 2017, vol. 19, issue 2, 429-443

Abstract: Abstract The Benjamini-Hochberg procedure (BH) controls the false discovery rate (FDR), and on a large dataset optimizes signal discovery subject to this control. However it applies a common p-value rejection threshold that precludes it from taking advantage of index information of the null hypotheses, making it suboptimal for detecting clustered signals. We propose a double application of the BH procedure on two-level hierarchical and related datasets, the first application to identify p-value batches, and a second application on each identified batch for null hypotheses rejections. We propose a mixture model on two tiers to model signal clustering, and show that on this model, the double application reduces FDR and maintains the power of BH. We show that the doubly applied BH satisfies an average FDR control. Benjamini and Bogomolov (J R Stat Soc Ser B 76:297–318, 2014) considered a more general class of procedures and error criterions, and showed average FDR control under dependency assumptions different from ours. Their proof is also technically different. We end the paper with a description of Yekutieli’s (J Am Stat Assoc 103:309–316, 2008) procedure on hierarchical datasets, and a proposed hybrid of the double BH procedure and Yekutieli’s procedure that combines the strengths of both.

Keywords: Cluster detection; FDR control; Hierarchical datasets; Multiple hypothesis testing; PPV; Sensitivity; 62L10 (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11009-016-9491-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:metcap:v:19:y:2017:i:2:d:10.1007_s11009-016-9491-x

Ordering information: This journal article can be ordered from
https://www.springer.com/journal/11009

DOI: 10.1007/s11009-016-9491-x

Access Statistics for this article

Methodology and Computing in Applied Probability is currently edited by Joseph Glaz

More articles in Methodology and Computing in Applied Probability from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().