Maximum likelihood estimation of a multi‐dimensional log‐concave density

Madeleine Cule, Richard Samworth and Michael Stewart

Journal of the Royal Statistical Society Series B, 2010, vol. 72, issue 5, 545-607

Abstract: Summary. Let X1,…,Xn be independent and identically distributed random vectors with a (Lebesgue) density f. We first prove that, with probability 1, there is a unique log‐concave maximum likelihood estimator of f. The use of this estimator is attractive because, unlike kernel density estimation, the method is fully automatic, with no smoothing parameters to choose. Although the existence proof is non‐constructive, we can reformulate the issue of computing in terms of a non‐differentiable convex optimization problem, and thus combine techniques of computational geometry with Shor's r‐algorithm to produce a sequence that converges to . An R version of the algorithm is available in the package LogConcDEAD—log‐concave density estimation in arbitrary dimensions. We demonstrate that the estimator has attractive theoretical properties both when the true density is log‐concave and when this model is misspecified. For the moderate or large sample sizes in our simulations, is shown to have smaller mean integrated squared error compared with kernel‐based methods, even when we allow the use of a theoretical, optimal fixed bandwidth for the kernel estimator that would not be available in practice. We also present a real data clustering example, which shows that our methodology can be used in conjunction with the expectation–maximization algorithm to fit finite mixtures of log‐concave densities.

Date: 2010
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (22)

Downloads: (external link)
https://doi.org/10.1111/j.1467-9868.2010.00753.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:72:y:2010:i:5:p:545-607

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().