Enhancing the Reliability of Cloud Data through Identifying Data Inconsistency between Cloud Systems

Tsozen Yeh () and Chiahung Sun
Additional contact information
Tsozen Yeh: Fu Jen Catholic University
Chiahung Sun: Fu Jen Catholic University

Information Systems Frontiers, 2024, vol. 26, issue 6, No 19, 2337-2345

Abstract: Abstract The technologies of cloud and Internet of Things (IoT) have been extensively applied to many areas in our lives. The large amount of data collected from cloud applications and IoT devices is often maintained and processed by cloud systems. It is imperative to ensure the reliability of data stored on cloud systems when hardware failure occurs. The Apache Hadoop is one of the most popular cloud systems in academia and industry. To deal with hardware failure, its default file system, Hadoop Distributed File System (HDFS), keeps multiple duplicates of every data block it stores. Nevertheless, in the case of a total loss of a cloud, preserving multiple copies of data blocks still cannot assure their reliability. Hadoop provides a tool, distcp (distributed copy), to copy data from cloud to cloud to address this issue. Practically, data inconsistency caused by human mistakes or accidents may exist between data duplicated across clouds, which could significantly reduce the data reliability. Unfortunately, Hadoop does not provide efficient ways to locate discrepancies of duplicated data between clouds. Without data reliability, all corresponding data processing and decision making could be greatly affected. Therefore, it is crucial to detect the inconsistency between duplicated data stored on different clouds to uphold the data reliability. We designed and implemented a new scheme in Hadoop to efficiently identify data inconsistency between clouds. As a result, the reliability of data kept on clouds could be greatly enhanced.

Keywords: Cloud Computing; Data Reliability; Hadoop; HDFS (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10796-023-10405-6 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:infosf:v:26:y:2024:i:6:d:10.1007_s10796-023-10405-6

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10796

DOI: 10.1007/s10796-023-10405-6

Access Statistics for this article

Information Systems Frontiers is currently edited by Ram Ramesh and Raghav Rao

More articles in Information Systems Frontiers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().