Monitoring Framework for the Performance Evaluation of an IoT Platform with Elasticsearch and Apache Kafka

Gonzalo Calderon (), Guillermo del Campo (), Edgar Saavedra () and Asunción Santamaría ()
Additional contact information
Gonzalo Calderon: Universidad Politécnica de Madrid
Guillermo del Campo: Universidad Politécnica de Madrid
Edgar Saavedra: Universidad Politécnica de Madrid
Asunción Santamaría: Universidad Politécnica de Madrid

Information Systems Frontiers, 2024, vol. 26, issue 6, No 21, 2373-2389

Abstract: Abstract IoT platforms are in charge of extracting and processing the data that come from IoT networks, generating additional value, and providing access to the user through usable interfaces. However, the ever growing number of devices, networks, services and applications within the IoT ecosystem, and the recently adopted edge/cloud architecture, increase the complexity. Therefore, IoT platforms should integrate monitoring and visualization tools to facilitate deployment, management and maintenance tasks. In this work, we present the implementation and performance evaluation of an IoT modular platform for distributed architectures that combines the use of Elastic Stack tools (Elasticsearch, Kibana and Beats) and Apache Kafka. We have developed a monitoring framework based on Beats agents that supervise the platform performance attending to different metrics; and adapted the Kibana visualization tools to provide friendly and accessible information to platform administrators and users. Finally, we have deployed and evaluated the IoT platform in four real use cases, identifying the factors that affect the performance of the different modules: Edge Node, Data Streaming, Cloud Server and Search Engine.

Keywords: IoT platfom; Elastic Stack; Elasticsearch; Kibana; Beats; Monitoring (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10796-023-10409-2 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:infosf:v:26:y:2024:i:6:d:10.1007_s10796-023-10409-2

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10796

DOI: 10.1007/s10796-023-10409-2

Access Statistics for this article

Information Systems Frontiers is currently edited by Ram Ramesh and Raghav Rao

More articles in Information Systems Frontiers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().