Shape constrained density estimation via penalized Rényi divergence

Roger Koenker () and Ivan Mizera
Additional contact information
Roger Koenker: Institute for Fiscal Studies and UCL
Ivan Mizera: Institute for Fiscal Studies

No CWP54/18, CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies

Abstract: Shape constraints play an increasingly prominent role in nonparametric function estimation. While considerable recent attention has been focused on log concavity as a regularizing device in nonparametric density estimation, weaker forms of concavity constraints encompassing larger classes of densities have received less attention but offer some additional flexibility. Heavier tail behavior and sharper modal peaks are better adapted to such weaker concavity constraints. When paired with appropriate maximal entropy estimation criteria these weaker constraints yield tractable, convex optimization problems that broaden the scope of shape constrained density estimation in a variety of applied subject areas. In contrast to our prior work, Koenker and Mizera (2010), that focused on the log concave (a = 1) and Hellinger (a = 1/2) constraints, here we describe methods enabling imposition of even weaker, a = 0 constraints. An alternative formulation of the concavity constraints for densities in dimension d = 2 also signi cantly expands the applicability of our proposed methods for multivariate data. Finally, we illustrate the use of the Renyi divergence criterion for norm-constrained estimation of densities in the absence of a shape constraint.

Date: 2018-09-18
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.ifs.org.uk/uploads/cemmap/wps/CWP541818.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (https://www.ifs.org.uk/uploads/cemmap/wps/CWP541818.pdf [302 Found]--> https://ifs.org.uk/uploads/cemmap/wps/CWP541818.pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ifs:cemmap:54/18

Ordering information: This working paper can be ordered from
The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

Access Statistics for this paper

More papers in CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE. Contact information at EDIRC.
Bibliographic data for series maintained by Emma Hyman ().