Model Selection in Kernel Ridge Regression
Peter Exterkate ()
CREATES Research Papers from Department of Economics and Business Economics, Aarhus University
Abstract:
Kernel ridge regression is gaining popularity as a data-rich nonlinear forecasting tool, which is applicable in many different contexts. This paper investigates the influence of the choice of kernel and the setting of tuning parameters on forecast accuracy. We review several popular kernels, including polynomial kernels, the Gaussian kernel, and the Sinc kernel. We interpret the latter two kernels in terms of their smoothing properties, and we relate the tuning parameters associated to all these kernels to smoothness measures of the prediction function and to the signal-to-noise ratio. Based on these interpretations, we provide guidelines for selecting the tuning parameters from small grids using cross-validation. A Monte Carlo study confirms the practical usefulness of these rules of thumb. Finally, the flexible and smooth functional forms provided by the Gaussian and Sinc kernels makes them widely applicable, and we recommend their use instead of the popular polynomial kernels in general settings, in which no information on the data-generating process is available.
Keywords: Nonlinear forecasting; shrinkage estimation; kernel methods; high dimensionality (search for similar items in EconPapers)
JEL-codes: C51 C53 C63 (search for similar items in EconPapers)
Pages: 22
Date: 2012-02-28
New Economics Papers: this item is included in nep-ecm and nep-for
References: Add references at CitEc
Citations: View citations in EconPapers (3)
Downloads: (external link)
https://repec.econ.au.dk/repec/creates/rp/12/rp12_10.pdf (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:aah:create:2012-10
Access Statistics for this paper
More papers in CREATES Research Papers from Department of Economics and Business Economics, Aarhus University
Bibliographic data for series maintained by ().