Small steps to accuracy: Incremental belief updaters are better forecasters

Pavel Atanasov, Jens Witkowski, Lyle Ungar, Barbara Mellers and Philip Tetlock

Organizational Behavior and Human Decision Processes, 2020, vol. 160, issue C, 19-35

Abstract: Laboratory research has shown that both underreaction and overreaction to new information pose threats to forecasting accuracy. This article explores how real-world forecasters who vary in skill attempt to balance these threats. We distinguish among three aspects of updating: frequency, magnitude, and confirmation propensity. Drawing on data from a four-year forecasting tournament that elicited over 400,000 probabilistic predictions on almost 500 geopolitical questions, we found that the most accurate forecasters made frequent, small updates, while low-skill forecasters were prone to confirm initial judgments or make infrequent, large revisions. High-frequency updaters scored higher on crystallized intelligence and open-mindedness, accessed more information, and improved over time. Small-increment updaters had higher fluid intelligence scores, and derived their advantage from initial forecasts. Update magnitude mediated the causal effect of training on accuracy. Frequent, small revisions provided reliable and valid signals of skill. These updating patterns can help organizations identify talent for managing uncertain prospects.

Keywords: Belief revision; Belief updating; Prediction; Forecasting (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0749597819300949
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jobhdp:v:160:y:2020:i:c:p:19-35

DOI: 10.1016/j.obhdp.2020.02.001

Access Statistics for this article

Organizational Behavior and Human Decision Processes is currently edited by John M. Schaubroeck

More articles in Organizational Behavior and Human Decision Processes from Elsevier
Bibliographic data for series maintained by Catherine Liu ().