TinyML Algorithms for Big Data Management in Large-Scale IoT Systems

Aristeidis Karras (), Anastasios Giannaros, Christos Karras (), Leonidas Theodorakopoulos, Constantinos S. Mammassis, George A. Krimpas and Spyros Sioutas
Additional contact information
Aristeidis Karras: Computer Engineering and Informatics Department, University of Patras, 26504 Patras, Greece
Anastasios Giannaros: Computer Engineering and Informatics Department, University of Patras, 26504 Patras, Greece
Christos Karras: Computer Engineering and Informatics Department, University of Patras, 26504 Patras, Greece
Leonidas Theodorakopoulos: Department of Management Science and Technology, University of Patras, 26334 Patras, Greece
Constantinos S. Mammassis: Department of Industrial Management and Technology, University of Piraeus, 18534 Piraeus, Greece
George A. Krimpas: Computer Engineering and Informatics Department, University of Patras, 26504 Patras, Greece
Spyros Sioutas: Computer Engineering and Informatics Department, University of Patras, 26504 Patras, Greece

Future Internet, 2024, vol. 16, issue 2, 1-29

Abstract: In the context of the Internet of Things (IoT), Tiny Machine Learning (TinyML) and Big Data, enhanced by Edge Artificial Intelligence, are essential for effectively managing the extensive data produced by numerous connected devices. Our study introduces a set of TinyML algorithms designed and developed to improve Big Data management in large-scale IoT systems. These algorithms, named TinyCleanEDF, EdgeClusterML, CompressEdgeML, CacheEdgeML, and TinyHybridSenseQ, operate together to enhance data processing, storage, and quality control in IoT networks, utilizing the capabilities of Edge AI. In particular, TinyCleanEDF applies federated learning for Edge-based data cleaning and anomaly detection. EdgeClusterML combines reinforcement learning with self-organizing maps for effective data clustering. CompressEdgeML uses neural networks for adaptive data compression. CacheEdgeML employs predictive analytics for smart data caching, and TinyHybridSenseQ concentrates on data quality evaluation and hybrid storage strategies. Our experimental evaluation of the proposed techniques includes executing all the algorithms in various numbers of Raspberry Pi devices ranging from one to ten. The experimental results are promising as we outperform similar methods across various evaluation metrics. Ultimately, we anticipate that the proposed algorithms offer a comprehensive and efficient approach to managing the complexities of IoT, Big Data, and Edge AI.

Keywords: TinyML; Edge AI; IoT; IoT data engineering; IoT Big Data management; IoT systems (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/16/2/42/pdf (application/pdf)
https://www.mdpi.com/1999-5903/16/2/42/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:16:y:2024:i:2:p:42-:d:1326236

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().