Distributions associated with simultaneous multiple hypothesis testing

Chang Yu () and Daniel Zelterman ()
Additional contact information
Chang Yu: Vanderbilt University Medical Center
Daniel Zelterman: Yale University

Journal of Statistical Distributions and Applications, 2020, vol. 7, issue 1, 1-17

Abstract: Abstract We develop the distribution for the number of hypotheses found to be statistically significant using the rule from Simes (Biometrika 73: 751–754, 1986) for controlling the family-wise error rate (FWER). We find the distribution of the number of statistically significant p-values under the null hypothesis and show this follows a normal distribution under the alternative. We propose a parametric distribution ΨI(·) to model the marginal distribution of p-values sampled from a mixture of null uniform and non-uniform distributions under different alternative hypotheses. The ΨI distribution is useful when there are many different alternative hypotheses and these are not individually well understood. We fit ΨI to data from three cancer studies and use it to illustrate the distribution of the number of notable hypotheses observed in these examples. We model dependence in sampled p-values using a latent variable. These methods can be combined to illustrate a power analysis in planning a larger study on the basis of a smaller pilot experiment.

Keywords: Bonferroni correction; Simes criteria; False discovery rate; p-values (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1186/s40488-020-00109-6 Abstract (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jstada:v:7:y:2020:i:1:d:10.1186_s40488-020-00109-6

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/40488

DOI: 10.1186/s40488-020-00109-6

Access Statistics for this article

Journal of Statistical Distributions and Applications is currently edited by Felix Famoye and Carl Lee

More articles in Journal of Statistical Distributions and Applications from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().