An Analysis on Task Migration Strategy of Big Data Streaming Storm Computing Framework for Distributed Processing

Xiling Hu
Additional contact information
Xiling Hu: Jiangxi Vocational College of Finance and Economics, China

International Journal of Information System Modeling and Design (IJISMD), 2020, vol. 11, issue 4, 18-35

Abstract: In this modern era, a large volume of data is generated regularly, which needs to be processed for gaining profits of latent information. The processing of big data is composed of a challenge termed as communication overhead. In order to minimize communication overhead on the premise of various resource constraints, a task migration strategy under heterogeneous storm environment is proposed. The proposed strategy is based on the establishment and demonstration of storm resource constraint model, optimal communication overhead model, and task migration model. Where the source node selection algorithm adds the nodes beyond the threshold to the source node set according to the load of CPU, memory, and network bandwidth of each working node in the cluster and the priority order of various resources. The experiment shows that compared with the existing research, computing storm can effectively reduce the delay and communication overhead between nodes, and the execution overhead is small.

Date: 2020
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 18/IJISMD.2020100102 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jismd0:v:11:y:2020:i:4:p:18-35

Access Statistics for this article

International Journal of Information System Modeling and Design (IJISMD) is currently edited by Thierry O. C. Edoh

More articles in International Journal of Information System Modeling and Design (IJISMD) from IGI Global
Bibliographic data for series maintained by Journal Editor ().