More predictable than ever, with the worst MSPE ever

Pablo Pincheira and Nicolás Hardy
Additional contact information
Nicolás Hardy: Facultad de Administración y Economía Universidad Diego Portales.

Journal for Economic Forecasting, 2024, issue 4, 5-30

Abstract: A fairly common approach to evaluate if a given time series Y_(t+1) is predictable, compares the Mean Squared Prediction Error (MSPE) of a plausible predictor for Y_(t+1) and the MSPE of a naïve benchmark like a constant forecast or the historical average of the predictand, which display zero or a small covariance with the target variable. If the MSPE of the plausible predictor is lower than that of the benchmark, Y_(t+1) is considered predictable, otherwise is considered unpredictable. This intuitive and standard approach might not be truly capturing the essence of predictability, which in words of some authors refers to a notion of dependence between the target variable and variables or events that happened in the past. In particular, when the plausible forecast under evaluation is inefficient, it might face a paradoxical situation: On the one hand, it could have a strong and positive correlation with the target variable, much greater than the correlation of the benchmark with the same target variable. Yet, on the other hand, it could be outperformed in terms of MSPE by the same naïve benchmark. We propose to evaluate predictability directly, with a simple test based on the covariance between the forecast and the target variable. Using Monte Carlo simulations we study size and power of three variations of this test. In general terms, they all behave reasonably well. We also compare their behavior with a traditional test of equality in MSPE. We show that our covariance tests can detect predictability even when MSPE comparisons do not. Finally, we illustrate the relevance of our observation when forecasting monthly oil returns with a forecast based on the Chilean peso.

Keywords: Mean Squared Prediction Error; Correlation; Forecasting; Time Series; Random Walk (search for similar items in EconPapers)
JEL-codes: C52 C53 E27 E37 F37 G17 L74 O18 R31 (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.ipe.ro/ftp/RePEc/rjef4_2024/rjef4_2024p5-30.pdf

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:rjr:romjef:v::y:2024:i:4:p:5-30

Access Statistics for this article

Journal for Economic Forecasting is currently edited by Lucian Liviu Albu and Corina Saman

More articles in Journal for Economic Forecasting from Institute for Economic Forecasting Contact information at EDIRC.
Bibliographic data for series maintained by Corina Saman ( this e-mail address is bad, please contact ).