Inferring Independent Sets of Gaussian Variables after Thresholding Correlations

Arkajyoti Saha, Daniela Witten and Jacob Bien

Journal of the American Statistical Association, 2025, vol. 120, issue 549, 370-381

Abstract: We consider testing whether a set of Gaussian variables, selected from the data, is independent of the remaining variables. This set is selected via a very simple approach: these are the variables for which the correlation with all other variables falls below some threshold. Unlike other settings in selective inference, failure to account for the selection step leads to excessively conservative (as opposed to anti-conservative) results. We propose a new test that conditions on the event that the selection resulted in the set of variables in question, and thus is not overly conservative. To achieve computational tractability, we develop a characterization of the conditioning event in terms of the canonical correlation between groups of random variables. In simulation studies and in the analysis of gene co-expression networks, we show that our approach has much higher power than a “naive” approach that ignores the effect of selection. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/01621459.2024.2337158 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:jnlasa:v:120:y:2025:i:549:p:370-381

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/UASA20

DOI: 10.1080/01621459.2024.2337158

Access Statistics for this article

Journal of the American Statistical Association is currently edited by Xuming He, Jun Liu, Joseph Ibrahim and Alyson Wilson

More articles in Journal of the American Statistical Association from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().