Extracting Functional Dependencies in Large Datasets Using MapReduce Model

K. Amshakala, R. Nedunchezhian and M. Rajalakshmi
Additional contact information
K. Amshakala: Department of CSE and IT, Coimbatore Institute of Technology, Coimbatore, India
R. Nedunchezhian: Department of CSE, Sri Ranganathar Institute of Engineering and Technology, Coimbatore, India
M. Rajalakshmi: Department of CSE and IT, Coimbatore Institute of Technology, Coimbatore, India

International Journal of Intelligent Information Technologies (IJIIT), 2014, vol. 10, issue 3, 19-35

Abstract: Over the last few years, data are generated in large volume at a faster rate and there has been a remarkable growth in the need for large scale data processing systems. As data grows larger in size, data quality is compromised. Functional dependencies representing semantic constraints in data are important for data quality assessment. Executing functional dependency discovery algorithms on a single computer is hard and laborious with large data sets. MapReduce provides an enabling technology for large scale data processing. The open-source Hadoop implementation of MapReduce has provided researchers a powerful tool for tackling large-data problems in a distributed manner. The objective of this study is to extract functional dependencies between attributes from large datasets using MapReduce programming model. Attribute entropy is used to measure the inter attribute correlations, and exploited to discover functional dependencies hidden in the data.

Date: 2014
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/ijiit.2014070102 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jiit00:v:10:y:2014:i:3:p:19-35

Access Statistics for this article

International Journal of Intelligent Information Technologies (IJIIT) is currently edited by Vijayan Sugumaran

More articles in International Journal of Intelligent Information Technologies (IJIIT) from IGI Global
Bibliographic data for series maintained by Journal Editor ().