Data vintages and measuring forecast model performance

John Robertson and Ellis Tallman

Economic Review, 1998, vol. 83, issue Q 4, 4-20

Abstract: The data on economic variables are usually estimates, and these estimates may be revised many times after their initial publication. Most historical forecast evaluation exercises use the \"latest available\" or most recently revised vintage of historical data when constructing the forecasts-that is, they use estimates that may well have been unavailable to a forecaster in real time. Evaluations using such data could thus give a misleading picture of the forecast performance that can be expected in real-time situations. This fact is particularly relevant if a forecasting model's performance is to be compared with that of published real-time forecasts. One practical question is whether actually using the data set available to a forecaster in real time would lead to inferences that are substantially different from those made using the latest available vintage of data. A related question is whether it matters which vintage of data the forecasts are evaluated against. ; The authors argue that the choice of data vintage can have both a quantitative and a qualitative influence on forecast and model comparisons, at least over short horizons. This influence is illustrated by examining the performance of the composite index of leading indicators as a forecaster of alternative measures of real output. However, more research is required in order to determine whether the results generalize to forecasts of other series that are subject to revision, such as the various money aggregate measures.

Keywords: Econometric models; Economic indicators; Forecasting (search for similar items in EconPapers)
Date: 1998
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (37)

Downloads: (external link)
https://www.frbatlanta.org/-/media/documents/resea ... obertson-tallman.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fip:fedaer:y:1998:i:q4:p:4-20:n:v.83no.4

Ordering information: This journal article can be ordered from

Access Statistics for this article

More articles in Economic Review from Federal Reserve Bank of Atlanta Contact information at EDIRC.
Bibliographic data for series maintained by Meredith Rector ().