Reaching for the stars: attention to multiple testing problems and method recommendations using simulation for business research

Christina C. Bartenschlager () and Jens O. Brunner
Additional contact information
Christina C. Bartenschlager: University of Augsburg, University Center of Health Sciences at Klinikum Augsburg (UNIKA-T)
Jens O. Brunner: University of Augsburg, University Center of Health Sciences at Klinikum Augsburg (UNIKA-T)

Journal of Business Economics, 2019, vol. 89, issue 4, No 4, 447-479

Abstract: Abstract Multiple hypotheses tests decide on more than one hypothesis based upon the same data set. Despite the significant relevance for business research, we find that multiple testing methods are not systematically applied in our research area. As surprising this finding is, as crucial it is to the significance of research findings. False positive findings can inflate with the number of employed single tests. The focus on medicine and psychology related topics of current multiple testing literature might deter business researchers from employing the tests. Hence, we provide guidance to researchers by exposing the importance of multiple testing. Based on an application oriented systematization, Monte Carlo simulations, and a decision theoretic evaluation scheme, we highlight method recommendations for different conservatism definitions regarding errors. As implicit results we find, that the dependency structure in the data does not influence the method outcomes significantly. In addition, intuitive single step margin based approaches perform similar than sophisticated tests for typical multiple testing problems in a conservative setting. More liberal methods show a stable relation for all simulation designs.

Keywords: Multiple testing; Simultaneous inference; Simulation; Method selection (search for similar items in EconPapers)
JEL-codes: C12 C15 M00 (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11573-018-0919-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:jbecon:v:89:y:2019:i:4:d:10.1007_s11573-018-0919-3

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/11573

DOI: 10.1007/s11573-018-0919-3

Access Statistics for this article

Journal of Business Economics is currently edited by Günter Fandel

More articles in Journal of Business Economics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().