Simultaneous testing of multiple hypotheses using generalized p-values

Kam-Wah Tsui and Shijie Tang

Statistics & Probability Letters, 2007, vol. 77, issue 12, 1362-1370

Abstract: In the context of simultaneously testing many hypotheses, Benjamini and Hochberg [1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B (Methodological) 57, 289-300] propose a procedure that guarantees that the false discovery rate (FDR) will be less than or equal to a specified value. Here, the FDR is the expected value of the ratio of the number of incorrectly rejected hypotheses and the total number of rejected hypotheses. To our knowledge, all of the existing research assumes that a usual p-value is available for each hypothesis. However, in circumstances when nuisance parameters are present, the usual p-values may not be free of the nuisance parameters. We develop a simultaneous testing procedure to control the FDR for the problem of simultaneously testing many Behrens-Fisher problems. Our multiple testing procedure, based on generalized p-values [Tsui, K.-W., Weerahandi, S., 1989. Generalized p-values in significance testing of hypotheses in the presence of nuisance parameters. J. Amer. Statist. Assoc. 84(406), 602-607], is then illustrated with an application to data from a microarray experiment.

Keywords: Behrens-Fisher; problem; False; discovery; rate; Ratio; of; two; normal; means; Microarray; data (search for similar items in EconPapers)
Date: 2007
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167-7152(07)00100-9
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:stapro:v:77:y:2007:i:12:p:1362-1370

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Statistics & Probability Letters is currently edited by Somnath Datta and Hira L. Koul

More articles in Statistics & Probability Letters from Elsevier
Bibliographic data for series maintained by Catherine Liu ().