Cross-validation based forecasting method: a machine learning approach

Jeronymo Marcondes Pinto and Emerson Marçal

No 498, Textos para discussão from FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil)

Abstract: Our paper aims to evaluate two novel methods on selecting the best forecasting model or its combination based on a Machine Learning approach. The methods are based on the selection of the ”best” model, or combination of models, by crossvalidation technique, from a set of possible models. The first one is based on the seminal paper of Granger-Bates (1969) but weights are estimated by a process of cross-validation applied on the training set. The second one selects the model with the best forecasting performance in the process described above, which we called CvML (Cross-Validation Machine Learning Method). The following models are used: exponential smoothing, SARIMA, artificial neural networks and Threshold autoregression (TAR). Model specification is chosen by R packages: forecast and TSA. Both methods – CvML and MGB - are applied to these models to generate forecasts from one up to twelve periods ahead. Frequency of data is monthly. We run the forecasts exercise to the following to monthly series of Industrial Product Indices for seven countries: Canada, Brazil, Belgium, Germany, Portugal, UK and USA. The data was collected at OECD data, with 504 observations. We choose Average Forecast Combination, Granger Bates Method, MCS model, Naive and Seasonal Naive Model as benchmarks.Our results suggest that MGB did not performed well. However, CvML had a lower mean absolute error for most of countries and forecast horizons, particularly at longer horizons, surpassing all the proposed benchmarks. Similar results hold for absolute mean forecast error.

Date: 2019-02
New Economics Papers: this item is included in nep-big, nep-cmp, nep-ets and nep-for
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://repositorio.fgv.br/bitstreams/2688bba9-0f0 ... 6a8d5c29ddc/download (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fgv:eesptd:498

Access Statistics for this paper

More papers in Textos para discussão from FGV EESP - Escola de Economia de São Paulo, Fundação Getulio Vargas (Brazil) Contact information at EDIRC.
Bibliographic data for series maintained by Núcleo de Computação da FGV EPGE ().