Overfitting in Judgment-based Economic Forecasts: The Case of IMF Growth Projections
Klaus-Peter Hellwig
No 2018/260, IMF Working Papers from International Monetary Fund
Abstract:
I regress real GDP growth rates on the IMF’s growth forecasts and find that IMF forecasts behave similarly to those generated by overfitted models, placing too much weight on observable predictors and underestimating the forces of mean reversion. I identify several such variables that explain forecasts well but are not predictors of actual growth. I show that, at long horizons, IMF forecasts are little better than a forecasting rule that uses no information other than the historical global sample average growth rate (i.e., a constant). Given the large noise component in forecasts, particularly at longer horizons, the paper calls into question the usefulness of judgment-based medium and long-run forecasts for policy analysis, including for debt sustainability assessments, and points to statistical methods to improve forecast accuracy by taking into account the risk of overfitting.
Keywords: WP; growth projection; WEO forecast; LASSO coefficient; bootstrapped sample; shrinkage coefficient; Forecasting; GDP growth; machine learning; Personal income; Real exchange rates; Emerging and frontier financial markets; Population growth; Global; inflation dynamics; IMF growth projection; Euro area inflation dynamics; copyright page; area inflation dynamics; Income (search for similar items in EconPapers)
Pages: 43
Date: 2018-12-07
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)
Downloads: (external link)
http://www.imf.org/external/pubs/cat/longres.aspx?sk=46390 (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:imf:imfwpa:2018/260
Ordering information: This working paper can be ordered from
http://www.imf.org/external/pubs/pubs/ord_info.htm
Access Statistics for this paper
More papers in IMF Working Papers from International Monetary Fund International Monetary Fund, Washington, DC USA. Contact information at EDIRC.
Bibliographic data for series maintained by Akshay Modi ().