Statistical sparsity

Peter McCullagh and Nicholas G Polson

Biometrika, 2018, vol. 105, issue 4, 797-814

Abstract: SummaryThe main contribution of this paper is a mathematical definition of statistical sparsity, which is expressed as a limiting property of a sequence of probability distributions. The limit is characterized by an exceedance measure $H$ and a rate parameter $\rho > 0$, both of which are unrelated to sample size. The definition encompasses all sparsity models that have been suggested in the signal-detection literature. Sparsity implies that $\rho$ is small, and a sparse approximation is asymptotic in the rate parameter, typically with error $o(\rho)$ in the sparse limit $\rho \to 0$. To first order in sparsity, the sparse signal plus Gaussian noise convolution depends on the signal distribution only through its rate parameter and exceedance measure. This is one of several asymptotic approximations implied by the definition, each of which is most conveniently expressed in terms of the zeta transformation of the exceedance measure. One implication is that two sparse families having the same exceedance measure are inferentially equivalent and cannot be distinguished to first order. Thus, aspects of the signal distribution that have a negligible effect on observables can be ignored with impunity, leaving only the exceedance measure to be considered. From this point of view, scale models and inverse-power measures seem particularly attractive.

Keywords: Convolution; Exceedance measure; False discovery; Infinite divisibility; Lévy measure; Post-selection inference; Signal activity; Signal-detection threshold; Tail inflation (search for similar items in EconPapers)
Date: 2018
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1093/biomet/asy051 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:biomet:v:105:y:2018:i:4:p:797-814.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

Biometrika is currently edited by Paul Fearnhead

More articles in Biometrika from Biometrika Trust Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK.
Bibliographic data for series maintained by Oxford University Press ().