Google Flu Trends Still Appears Sick: An Evaluation of the 2013?2014 Flu Season

David Lazer, Ryan Kennedy, Gary King and Alessandro Vespignani

Working Paper from Harvard University OpenScholar

Abstract: Last year was difficult for Google Flu Trends (GFT). In early 2013, Nature reported that GFT was estimating more than double the percentage of doctor visits for influenza like illness than the Centers for Disease Control and Prevention s (CDC) sentinel reports during the 2012 2013 flu season (1). Given that GFT was designed to forecast upcoming CDC reports, this was a problematic finding. In March 2014, our report in Science found that the overestimation problem in GFT was also present in the 2011 2012 flu season (2). The report also found strong evidence of autocorrelation and seasonality in the GFT errors, and presented evidence that the issues were likely, at least in part, due to modifications made by Google s search algorithm and the decision by GFT engineers not to use previous CDC reports or seasonality estimates in their models what the article labeled algorithm dynamics and big data hubris respectively. Moreover, the report and the supporting online materials detailed how difficult/impossible it is to replicate the GFT results, undermining independent efforts to explore the source of GFT errors and formulate improvements.

Date: 2014-01
New Economics Papers: this item is included in nep-hea
References: Add references at CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://gking.harvard.edu//node/155056

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:qsh:wpaper:155056

Access Statistics for this paper

More papers in Working Paper from Harvard University OpenScholar Contact information at EDIRC.
Bibliographic data for series maintained by Richard Brandon ( this e-mail address is bad, please contact ).