Testing sign congruence between two parameters

Douglas Miller, Francesca Molinari and Jörg Stoye

No 14/24, CeMMAP working papers from Institute for Fiscal Studies

Abstract: We test the null hypothesis that two parameters (μ1,μ2) have the same sign, assuming that (asymptotically) normal estimators (ˆμ1, ˆμ2) are available. Examples of this problem include the analysis of heterogeneous treatment effects, causal interpretation of reduced-form estimands, meta-studies, and mediation analysis. A number of tests were recently proposed. We recommend a test that is simple and rejects more often than many of these recent proposals. Like all other tests in the literature, it is conservative if the truth is near (0, 0) and therefore also biased. To clarify whether these features are avoidable, we also provide a test that is unbiased and has exact size control on the boundary of the null hypothesis, but which has counterintuitive properties and hence we do not recommend. We use the test to improve p-values in Kowalski (2022) from information contained in that paper’s main text and to establish statistical significance of some key estimates in Dippel et al. (2021).

Date: 2024-06-19
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.cemmap.ac.uk/wp-content/uploads/2024/0 ... n-two-parameters.pdf (application/pdf)

Related works:
Working Paper: Testing Sign Congruence Between Two Parameters (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:azt:cemmap:14/24

DOI: 10.47004/wp.cem.2024.1424

Access Statistics for this paper

More papers in CeMMAP working papers from Institute for Fiscal Studies Contact information at EDIRC.
Bibliographic data for series maintained by Dermot Watson ().