Sparse additive models

Pradeep Ravikumar, John Lafferty, Han Liu and Larry Wasserman

Journal of the Royal Statistical Society Series B, 2009, vol. 71, issue 5, 1009-1030

Abstract: Summary. We present a new class of methods for high dimensional non‐parametric regression and classification called sparse additive models. Our methods combine ideas from sparse linear modelling and additive non‐parametric regression. We derive an algorithm for fitting the models that is practical and effective even when the number of covariates is larger than the sample size. Sparse additive models are essentially a functional version of the grouped lasso of Yuan and Lin. They are also closely related to the COSSO model of Lin and Zhang but decouple smoothing and sparsity, enabling the use of arbitrary non‐parametric smoothers. We give an analysis of the theoretical properties of sparse additive models and present empirical results on synthetic and real data, showing that they can be effective in fitting sparse non‐parametric models in high dimensional data.

Date: 2009
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (53)

Downloads: (external link)
https://doi.org/10.1111/j.1467-9868.2009.00718.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:71:y:2009:i:5:p:1009-1030

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().