Prediction of time series by statistical learning: general losses and fast rates

Alquier Pierre (), Li Xiaoyin and Olivier Wintenberger
Additional contact information
Alquier Pierre: University College Dublin, School of Mathematical Sciences
Li Xiaoyin: Université de Cergy, Laboratoire Analyse Géométrie Modélisation

Dependence Modeling, 2014, vol. 1, issue 2013, 65-93

Abstract: We establish rates of convergences in statistical learning for time series forecasting. Using the PAC-Bayesian approach, slow rates of convergence √ d/n for the Gibbs estimator under the absolute loss were given in a previous work [7], where n is the sample size and d the dimension of the set of predictors. Under the same weak dependence conditions, we extend this result to any convex Lipschitz loss function. We also identify a condition on the parameter space that ensures similar rates for the classical penalized ERM procedure. We apply this method for quantile forecasting of the French GDP. Under additional conditions on the loss functions (satisfied by the quadratic loss function) and for uniformly mixing processes, we prove that the Gibbs estimator actually achieves fast rates of convergence d/n. We discuss the optimality of these different rates pointing out references to lower bounds when they are available. In particular, these results bring a generalization the results of [29] on sparse regression estimation to some autoregression.

Keywords: Statistical learning theory; time series forecasting; PACBayesian bounds; weak dependence; mixing; oracle inequalities; fast rates; GDP forecasting (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://doi.org/10.2478/demo-2013-0004 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrs:demode:v:1:y:2014:i::p:65-93:n:4

DOI: 10.2478/demo-2013-0004

Access Statistics for this article

Dependence Modeling is currently edited by Giovanni Puccetti

More articles in Dependence Modeling from De Gruyter
Bibliographic data for series maintained by Peter Golla ().