Consonance and the closure method in multiple testing

Joseph P. Romano, Azeem Shaikh and Michael Wolf

No 446, IEW - Working Papers from Institute for Empirical Research in Economics - University of Zurich

Abstract: Consider the problem of testing s hypotheses simultaneously. In order to deal with the multiplicity problem, the classical approach is to restrict attention to procedures that control the familywise error rate (FWE). Typically, it is known how to construct tests of the individual hypotheses, and the problem is how to combine them into a multiple testing procedure that controls the FWE. The closure method of Marcus et al. (1976), in fact, reduces the problem of constructing multiple test procedures which control the FWE to the construction of single tests which control the usual probability of a Type 1 error. The purpose of this paper is to examine the closure method with emphasis on the concepts of coherence and consonance. It was shown by Sonnemann and Finner (1988) that any incoherent procedure can be replaced by a coherent one which is at least as good. The main point of this paper is to show a similar result for dissonant and consonant procedures. We illustrate the idea of how a dissonant procedure can be strictly improved by a consonant procedure in the sense of increasing the probability of detecting a false null hypothesis while maintaining control of the FWE. We then show how consonance can be used in the construction of some optimal maximin procedures.

Keywords: Multiple testing; closure method; coherence; consonance; familywise error rate (search for similar items in EconPapers)
JEL-codes: C12 C14 (search for similar items in EconPapers)
Date: 2009-09
New Economics Papers: this item is included in nep-ecm
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.zora.uzh.ch/id/eprint/51898/1/iewwp446.pdf (application/pdf)

Related works:
Journal Article: Consonance and the Closure Method in Multiple Testing (2011)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zur:iewwpx:446

Access Statistics for this paper

More papers in IEW - Working Papers from Institute for Empirical Research in Economics - University of Zurich
Bibliographic data for series maintained by Severin Oswald ().