Estimating linear functionals of a sparse family of Poisson means

Olivier Collier () and Arnak Dalalyan
Additional contact information
Olivier Collier: Modal’X, UPL, Univ Paris Nanterre

Statistical Inference for Stochastic Processes, 2018, vol. 21, issue 2, No 5, 344 pages

Abstract: Abstract Assume that we observe a sample of size n composed of p-dimensional signals, each signal having independent entries drawn from a scaled Poisson distribution with an unknown intensity. We are interested in estimating the sum of the n unknown intensity vectors, under the assumption that most of them coincide with a given “background” signal. The number s of p-dimensional signals different from the background signal plays the role of sparsity and the goal is to leverage this sparsity assumption in order to improve the quality of estimation as compared to the naive estimator that computes the sum of the observed signals. We first introduce the group hard thresholding estimator and analyze its mean squared error measured by the squared Euclidean norm. We establish a nonasymptotic upper bound showing that the risk is at most of the order of $$\sigma ^2(sp+s^2\sqrt{p}\log ^{3/2}(np))$$ σ 2 ( s p + s 2 p log 3 / 2 ( n p ) ) . We then establish lower bounds on the minimax risk over a properly defined class of collections of s-sparse signals. These lower bounds match with the upper bound, up to logarithmic terms, when the dimension p is fixed or of larger order than $$s^2$$ s 2 . In the case where the dimension p increases but remains of smaller order than $$s^2$$ s 2 , our results show a gap between the lower and the upper bounds, which can be up to order $$\sqrt{p}$$ p .

Keywords: Nonasymptotic minimax estimation; Linear functional; Group-sparsity; Thresholding; Poisson processes (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11203-018-9173-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sistpr:v:21:y:2018:i:2:d:10.1007_s11203-018-9173-0

Ordering information: This journal article can be ordered from
http://www.springer. ... ty/journal/11203/PS2

DOI: 10.1007/s11203-018-9173-0

Access Statistics for this article

Statistical Inference for Stochastic Processes is currently edited by Denis Bosq, Yury A. Kutoyants and Marc Hallin

More articles in Statistical Inference for Stochastic Processes from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().