Thinking and Modeling for Big Data from the Perspective of the I Ching

Chuang Lin, Guoliang Li, Zhiguang Shan and Yong Shi
Additional contact information
Chuang Lin: Department of Computer Science, Shenzhen University, Shenzhen, P. R. China†Department of Computer Science, Tsinghua University, Beijing, P. R. China
Guoliang Li: #x2020;Department of Computer Science, Tsinghua University, Beijing, P. R. China
Zhiguang Shan: State Information Center of China, Beijing, P. R. China
Yong Shi: University of Chinese Academy of Sciences, Beijing, P. R. China

International Journal of Information Technology & Decision Making (IJITDM), 2017, vol. 16, issue 06, 1451-1463

Abstract: Data is growing faster than ever before and is changing our daily life. However it is rather challenging to manage the big data [F. H. Cate, The big debate, Science 346 (2014) 810, J. Manyika, M. Chui, B. Brown, J. Bughin, R. Dobbs, C. Roxburgh and A. H. Byers, Big Data: The Next Frontier for Innovation, Competition, and Productivity (Mckinsey global Institute, 2011), S. Lohr, The Age of Big Data (New York Times, 2012), p. 11, L. Einav and J. Levin, Economics in the age of big data, Science 345 (2014) 715, M. J. Khoury and J. P. A. Ioannidis, Big data meets public health, Science 346 (2014) 1054–1055, V. Marx, Biology: The big challenges of big data, Nature 498(7453) (2013) 255–260.]. In this paper, we propose the big data thinking and modeling techniques from the perspective of the I Ching, which is a very famous imaginal thinking theory in China with 3,000 years history. The I Ching has been proven to be very useful and practical in many domains, e.g., 36 stratagems.Firstly, inspired from the three components of the I Ching, image, number and principle, we propose a new three-cycle big data thinking way, from data to phenomenon, from phenomenon to correlation, and from correlation to knowledge, which is a generalization of the fourth paradigm (from causality to correlation) proposed by Jim Gray.Secondly, inspired from the three entities of the I Ching, heaven, earth and human, we propose a new big data modeling method. We use the tree entities to represent the big data. We map the 4V of big data (volume, variety, velocity, veracity) to four opposition and uniform relations in the I Ching, and generate the eight diagrams. By capturing the relationships between eight diagrams, we generate the 64 hexagrams, and use 64 hexagrams to model big data. We also provide the principle rules to understand the knowledge generated by the model.Thirdly, we discuss how to utilize our model to describe big-data management tools, including, MapReduce, Spark, Storm. We also provide a new model for handling distributed data streams.We do think that we provide a new practical way of thinking and modeling for big data. We also believe that this will open up many new research directions on big data.

Keywords: Big data; I Ching; data modeling; data thinking (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219622017500286
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijitdm:v:16:y:2017:i:06:n:s0219622017500286

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219622017500286

Access Statistics for this article

International Journal of Information Technology & Decision Making (IJITDM) is currently edited by Yong Shi

More articles in International Journal of Information Technology & Decision Making (IJITDM) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().