A comparison of forecasting methods: fundamentals, polling, prediction markets, and experts

Deepak Pathak, David Rotschild and Miroslav Dudik

Journal of Prediction Markets, 2015, vol. 9, issue 2, 1-31

Abstract: We compare Oscar forecasts derived from four data types (fundamentals, polling, prediction markets, and domain experts) across three attributes (accuracy, timeliness and cost effectiveness). Fundamentals-based forecasts are relatively expensive to construct, an attribute the academic literature frequently ignores, and update slowly over time, constraining their accuracy. However, fundamentals provide valuable insights into the relationship between key indicators for nominated movies and their chances of victory. For instance, we find that the performance in other awards shows is highly predictive of the Oscar victory whereas box office results are not. Polling- based forecasts have the potential to be both accurate and timely. Timeliness requires incentives for frequent responses by high-information users. Accuracy is achieved by a proper transformation of raw polls. Prediction market prices are accurate forecasts, but can be further improved by simple transformations of raw prices, yielding the most accurate forecasts in our study. Expert forecasts exhibit some characteristics of fundamental models, but are generally not comparatively accurate or timely. This study is unique in both comparing and aggregating four traditional data sources, and considering critical attributes beyond accuracy. We believe that the results of this study generalize to many other domains.

Keywords: prediction; Oscars; regression; probabilities; translation; combining forecasts (search for similar items in EconPapers)
JEL-codes: L83 (search for similar items in EconPapers)
Date: 2015
References: Add references at CitEc
Citations:

Downloads: (external link)
http://ubplj.org/index.php/jpm/article/view/1048 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:buc:jpredm:v:9:y:2015:i:2:p:1-31

Ordering information: This journal article can be ordered from
http://www.predictio ... ex_files/Page418.htm

Access Statistics for this article

Journal of Prediction Markets is currently edited by Leighton Vaughan Williams, Nottingham Business School

More articles in Journal of Prediction Markets from University of Buckingham Press
Bibliographic data for series maintained by Dominic Cortis, University of Malta ().