Measuring News Sentiment

Adam Shapiro, Moritz Sudhof and Daniel Wilson

No 2017-1, Working Paper Series from Federal Reserve Bank of San Francisco

Abstract: This paper demonstrates state-of-the-art text sentiment analysis tools while developing a new time-series measure of economic sentiment derived from economic and financial newspaper articles from January 1980 to April 2015. We compare the predictive accuracy of a large set of sentiment analysis models using a sample of articles that have been rated by humans on a positivity/negativity scale. The results highlight the gains from combining existing lexicons and from accounting for negation. We also generate our own sentiment-scoring model, which includes a new lexicon built specifically to capture the sentiment in economic news articles. This model is shown to have better predictive accuracy than existing, “off-the-shelf”, models. Lastly, we provide two applications to the economic research on sentiment. First, we show that daily news sentiment is predictive of movements of survey-based measures of consumer sentiment. Second, motivated by Barsky and Sims (2012), we estimate the impulse responses of macroeconomic variables to sentiment shocks, finding that positive sentiment shocks increase consumption, output, and interest rates and dampen inflation.

Keywords: news; text sentiment analysis; economic sentiment; sentiment-scoring; sentiment shocks (search for similar items in EconPapers)
JEL-codes: E32 E37 (search for similar items in EconPapers)
Pages: 49 pages
Date: 2020-03-13
New Economics Papers: this item is included in nep-cmp and nep-mac
Note: First published 1/5/2017 as "Measuring News Sentiment", FRSBF ER Working Paper 2017-01. This updated version, published under same title and WP number, on 3/13/2020.
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (51)

Downloads: (external link)
http://www.frbsf.org/economic-research/files/wp2017-01.pdf Full text - article PDF (application/pdf)

Related works:
Journal Article: Measuring news sentiment (2022)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fip:fedfwp:2017-01

Ordering information: This working paper can be ordered from

DOI: 10.24148/wp2017-01

Access Statistics for this paper

More papers in Working Paper Series from Federal Reserve Bank of San Francisco Contact information at EDIRC.
Bibliographic data for series maintained by Federal Reserve Bank of San Francisco Research Library ().