Two-sample testing of high-dimensional linear regression coefficients via complementary sketching

Fengnan Gao and Tengyao Wang

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: We introduce a new method for two-sample testing of high-dimensional linear regression coefficients without assuming that those coefficients are individually estimable. The procedure works by first projecting the matrices of covariates and response vectors along directions that are complementary in sign in a subset of the coordinates, a process which we call ‘complementary sketching’. The resulting projected covariates and responses are aggregated to form two test statistics, which are shown to have essentially optimal asymptotic power under a Gaussian design when the difference between the two regression coefficients is sparse and dense respectively. Simulations confirm that our methods perform well in a broad class of settings and an application to a large single-cell RNA sequencing dataset demonstrates its utility in the real world.

Keywords: high-dimensional data; linear model; minimax detection; sparsity; two-sample hypothesis testing (search for similar items in EconPapers)
JEL-codes: C1 (search for similar items in EconPapers)
Date: 2022-10-01
New Economics Papers: this item is included in nep-ecm and nep-mac
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in Annals of Statistics, 1, October, 2022. ISSN: 0090-5364

Downloads: (external link)
http://eprints.lse.ac.uk/115644/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:115644

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager (lseresearchonline@lse.ac.uk).