Beyond Hadoop: Recent Directions in Data Computing for Internet Services

Zhiwei Xu, Bo Yan and Yongqiang Zou
Additional contact information
Zhiwei Xu: Chinese Academy of Sciences, China
Bo Yan: Chinese Academy of Sciences, China
Yongqiang Zou: Tencent Research, China

International Journal of Cloud Applications and Computing (IJCAC), 2011, vol. 1, issue 1, 45-61

Abstract: As a main subfield of cloud computing applications, internet services require large-scale data computing. Their workloads can be divided into two classes: customer-facing query-processing interactive tasks that serve hundreds of millions of users within a short response time and backend data analysis batch tasks that involve petabytes of data. Hadoop, an open source software suite, is used by many Internet services as the main data computing platform. Hadoop is also used by academia as a research platform and an optimization target. This paper presents five research directions for optimizing Hadoop; improving performance, utilization, power efficiency, availability, and different consistency constraints. The survey covers both backend analysis and customer-facing workloads. A total of 15 innovative techniques and systems are analyzed and compared, focusing on main research issues, innovative techniques, and optimized results.

Date: 2011
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/ijcac.2011010104 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jcac00:v:1:y:2011:i:1:p:45-61

Access Statistics for this article

International Journal of Cloud Applications and Computing (IJCAC) is currently edited by B. B. Gupta

More articles in International Journal of Cloud Applications and Computing (IJCAC) from IGI Global
Bibliographic data for series maintained by Journal Editor ().