Exploiting resampling techniques for model selection in forecasting: an empirical evaluation using out-of-sample tests

Dimitrios Sarris, Evangelos Spiliotis () and Vassilios Assimakopoulos
Additional contact information
Dimitrios Sarris: National Technical University of Athens
Evangelos Spiliotis: National Technical University of Athens
Vassilios Assimakopoulos: National Technical University of Athens

Operational Research, 2020, vol. 20, issue 2, No 10, 721 pages

Abstract: Abstract Model selection is a complex task widely examined in the literature due to the major gains in forecasting accuracy when performed successfully. To do so, many approaches have been proposed exploiting the available historical data in different ways. In-sample testing is the most common approach but is highly affected by the data and parameter estimation uncertainty. Out-of-sample tests, which use part of the data to evaluate the performance of the forecasting methods, are also well-known alternatives which usually lead to improvements. However, these are still vulnerable to data uncertainty such as noise and outliers. On the other hand, resampling techniques can be used to produce multiple clones of a time series with the same characteristics but a different component of randomness. In this paper, a model selection technique is proposed which takes advantage of the bootstrapping process to mitigate the effect of noise in the original data and then applies out-of-sample tests to the generated series to evaluate the forecasting performance of different methods. The approach is assessed across a large dataset of diverse time series and benchmarked versus other traditional approaches leading to promising results.

Keywords: Forecasting; Model selection; Bootstrapping; Resampling; Out-of-sample tests (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s12351-017-0347-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:operea:v:20:y:2020:i:2:d:10.1007_s12351-017-0347-0

Ordering information: This journal article can be ordered from
https://www.springer ... search/journal/12351

DOI: 10.1007/s12351-017-0347-0

Access Statistics for this article

Operational Research is currently edited by Nikolaos F. Matsatsinis, John Psarras and Constantin Zopounidis

More articles in Operational Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().