Evaluating Density Forecasts with Applications to ESPF

Kanemi Ban, Masaaki Kawagoe and Hideaki Matsuoka

ESRI Discussion paper series from Economic and Social Research Institute (ESRI)

Abstract: This paper evaluates density forecasts using micro data from the ESP forecast (ESPF), a monthly survey of Japanese professional forecasters. The ESPF has collected individual density forecasts since June 2008. We employ two approaches, Probability Integral Transform (PIT) and Ranked Probability Score (RPS). First, we apply Berkowitz’s (2001) test to individual density forecasts produced every June. We fail to reject the independency in FY 2010 and 2011 real GDP growth rates. As for CPI inflation rates, we reject the independency in all the samples during FY 2008 to 2011, but fail to reject it if the sample is limited to a half with better forecast performance. The result may ensure individual densities coincide with unobserved true data generation process of the actual outcomes. Second, we calculate RPS, following Kenny, Kostka, and Masera (2012), and compare the Mean Probability Distribution (MPD), the average of individual densities, with three benchmarks -- Uniform, Normal and Naïve distributions -- and individual density forecasts. The MPD turns out to be a “good” density: it beats the benchmarks in most cases and ranks about fifth out of around 35 participants every year. Subjective judgments added to the MPD are likely to deteriorate the performance in the case of CPI inflation rate, but to improve in the case of real GDP growth rate.

Pages: 21 pages
Date: 2013-09
New Economics Papers: this item is included in nep-for
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.esri.go.jp/jp/archive/e_dis/e_dis302/e_dis302.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 500 Can't connect to www.esri.go.jp:80 (No such host is known. )

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:esj:esridp:302

Access Statistics for this paper

More papers in ESRI Discussion paper series from Economic and Social Research Institute (ESRI) Contact information at EDIRC.
Bibliographic data for series maintained by HORI nobuko ( this e-mail address is bad, please contact ).