Modelling and smoothing parameter estimation with multiple quadratic penalties

S. N. Wood

Journal of the Royal Statistical Society Series B, 2000, vol. 62, issue 2, 413-428

Abstract: Penalized likelihood methods provide a range of practical modelling tools, including spline smoothing, generalized additive models and variants of ridge regression. Selecting the correct weights for penalties is a critical part of using these methods and in the single‐penalty case the analyst has several well‐founded techniques to choose from. However, many modelling problems suggest a formulation employing multiple penalties, and here general methodology is lacking. A wide family of models with multiple penalties can be fitted to data by iterative solution of the generalized ridge regression problem minimize ||W1/2 (Xp−y) ||2ρ+Σi=1m θip′Sip (p is a parameter vector, X a design matrix, Si a non‐negative definite coefficient matrix defining the ith penalty with associated smoothing parameter θi, W a diagonal weight matrix, y a vector of data or pseudodata and ρ an ‘overall’ smoothing parameter included for computational efficiency). This paper shows how smoothing parameter selection can be performed efficiently by applying generalized cross‐validation to this problem and how this allows non‐linear, generalized linear and linear models to be fitted using multiple penalties, substantially increasing the scope of penalized modelling methods. Examples of non‐linear modelling, generalized additive modelling and anisotropic smoothing are given.

Date: 2000
References: Add references at CitEc
Citations: View citations in EconPapers (88)

Downloads: (external link)
https://doi.org/10.1111/1467-9868.00240

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:62:y:2000:i:2:p:413-428

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().