Big Data Is a Big Deal But How Much Data Do We Need?

Nikos Askitas ()

No 9988, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: The more conservative among us believe that "Big Data is a fad that will soon fade out" and they may in fact be partially right. By contrast, others – especially those who dispassionately note that digitization is only now beginning to deliver its payload – may beg to differ. We argue that all things considered, Big Data will likely cease to exist, although this will happen less because it is a fad and more because all data will eventually be Big Data. In this essay, I pose and discuss the question of "how much data do we really need" since everything in life and hence the returns from data increments ought to obey some kind of law of diminishing returns: the more the better, but at some point the gains are not worth the effort or become negative. Accordingly, I discuss small and large, specific and general examples to shed light on this question. I do not exhaustively explore the answers, rather aiming more towards provoking thought among the reader. The main conclusions, nonetheless, are that depending on the use case both a deficit and an abundance of data may be counterproductive, that individuals, data experts, firms or society have different optimization problems whereby nothing will free us from having to reach decisions concerning how much data is enough data and that the greatest challenges that data-intensive societies will face are positive reinforcement, feedback mechanisms and data endogeneity.

Keywords: causality; social science; endogeneity; Big Data; prediction (search for similar items in EconPapers)
JEL-codes: C55 (search for similar items in EconPapers)
Pages: 14 pages
Date: 2016-06
New Economics Papers: this item is included in nep-net and nep-pay
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Published - published in: AStA Wirtschafts - und Sozialstatistisches Archiv, 2016, 10, 113 - 125

Downloads: (external link)
https://docs.iza.org/dp9988.pdf (application/pdf)

Related works:
Journal Article: Big Data is a big deal but how much data do we need? (2016)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp9988

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().