Assessing Spurious Correlations in Big Search Data

Jesse T. Richman () and Ryan J. Roberts
Additional contact information
Jesse T. Richman: Department of Political Science and Geography, Old Dominion University, BAL 7000, Norfolk, VA 23529, USA
Ryan J. Roberts: Department of Public Service, Gardner-Webb University, Boiling Springs, NC 28017, USA

Forecasting, 2023, vol. 5, issue 1, 1-12

Abstract: Big search data offers the opportunity to identify new and potentially real-time measures and predictors of important political, geographic, social, cultural, economic, and epidemiological phenomena, measures that might serve an important role as leading indicators in forecasts and nowcasts. However, it also presents vast new risks that scientists or the public will identify meaningless and totally spurious ‘relationships’ between variables. This study is the first to quantify that risk in the context of search data. We find that spurious correlations arise at exceptionally high frequencies among probability distributions examined for random variables based upon gamma (1, 1) and Gaussian random walk distributions. Quantifying these spurious correlations and their likely magnitude for various distributions has value for several reasons. First, analysts can make progress toward accurate inference. Second, they can avoid unwarranted credulity. Third, they can demand appropriate disclosure from the study authors.

Keywords: spurious correlation; Bonferroni; big data; big search data; Google Correlate; Google Trends; search data (search for similar items in EconPapers)
JEL-codes: A1 B4 C0 C1 C2 C3 C4 C5 C8 M0 Q2 Q3 Q4 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2571-9394/5/1/15/pdf (application/pdf)
https://www.mdpi.com/2571-9394/5/1/15/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jforec:v:5:y:2023:i:1:p:15-296:d:1082814

Access Statistics for this article

Forecasting is currently edited by Ms. Joss Chen

More articles in Forecasting from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().