Multi-Objective Big Data View Materialization Using NSGA-II

Akshay Kumar and T. V. Vijay Kumar
Additional contact information
Akshay Kumar: Jawaharlal Nehru University, India
T. V. Vijay Kumar: Jawaharlal Nehru University, India

Information Resources Management Journal (IRMJ), 2021, vol. 34, issue 2, 1-28

Abstract: Big data views, in the context of distributed file system (DFS), are defined over structured, semi-structured and unstructured data that are voluminous in nature with the purpose to reduce the response time of queries over Big data. As the size of semi-structured and unstructured data in Big data is very large compared to structured data, a framework based on query attributes on Big data can be used to identify Big data views. Materializing Big data views can enhance the query response time and facilitate efficient distribution of data over the DFS based application. Given all the Big data views cannot be materialized, therefore, a subset of Big data views should be selected for materialization. The purpose of view selection for materialization is to improve query response time subject to resource constraints. The Big data view materialization problem was defined as a bi-objective problem with the two objectives- minimization of query evaluation cost and minimization of the update processing cost, with a constraint on the total size of the materialized views. This problem is addressed in this paper using multi-objective genetic algorithm NSGA-II. The experimental results show that proposed NSGA-II based Big data view selection algorithm is able to select reasonably good quality views for materialization.

Date: 2021
References: Add references at CitEc
Citations: Track citations by RSS feed

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 4018/IRMJ.2021040101 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:rmj000:v:34:y:2021:i:2:p:1-28

Access Statistics for this article

Information Resources Management Journal (IRMJ) is currently edited by George Kelley

More articles in Information Resources Management Journal (IRMJ) from IGI Global
Bibliographic data for series maintained by Journal Editor ().