Knowing the signs: a direct and generalizable motivation of two‐sided tests

Kenneth Rice, Tyler Bonnett and Chloe Krakauer

Journal of the Royal Statistical Society Series A, 2020, vol. 183, issue 2, 411-430

Abstract: Many well‐known problems with two‐sided p‐values are due to their use in hypothesis tests, with ‘reject–accept’ conclusions about point null hypotheses. We present an alternative motivation for p‐value‐based tests, viewing them as assessments of only the sign of an underlying parameter, where we can conclude that the parameter is positive or negative, or simply say nothing either way. Our approach is decision theoretic, but—unusually—we consider the whole set of possible utility functions available. Doing this we show how, in a specific sense, close analogues of familiar one‐ and two‐sided tests are always the optimal decision. We argue that this simplicity could aid non‐experts’ understanding and use of tests—and help them to think critically about whether or not tests are appropriate tools for answering their questions of interest. Several extensions are also considered, showing that the simple idea of determining the signs of parameters yields a rich framework for inference.

Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://doi.org/10.1111/rssa.12496

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssa:v:183:y:2020:i:2:p:411-430

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-985X

Access Statistics for this article

Journal of the Royal Statistical Society Series A is currently edited by A. Chevalier and L. Sharples

More articles in Journal of the Royal Statistical Society Series A from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().