A distributed intrusion detection system based on apache spark and scikit-learn library

Mohamed Seghire Othman Djediden, Hicham Reguieg and Zoulikha Mekkakia Maaza
Additional contact information
Mohamed Seghire Othman Djediden: Laboratoire SIMPA, Universite des Sciences et de la Technologie d'Oran Mohamed Boudiaf, USTO-MB, Oran, Algeria
Hicham Reguieg: Laboratoire SIMPA, Universite des Sciences et de la Technologie d'Oran Mohamed Boudiaf, USTO-MB, Oran, Algeria
Zoulikha Mekkakia Maaza: Laboratoire SIMPA, Universite des Sciences et de la Technologie d'Oran Mohamed Boudiaf, USTO-MB, Oran, Algeria

Journal of Applied and Physical Sciences, 2019, vol. 5, issue 1, 30-36

Abstract: With the great explosion of data generated in computer networks. The main task of Intrusion Detection Systems (IDS) has become more complicated. Most of the existing IDS are deployed on a single server and do not support the distributed processing. These systems encountered several problems as soon as the volume of the data to be analysed is larger and more varied. The main goal of this paper is to create an intrusion detection system that can analyse massive data quickly with great precision while supporting distributed data processing. This type of data processing assures that our system will be more available and fault-tolerant. In our work, we have combined the Apache Spark framework with known feature selection methods and machine learning algorithms from the improved Sickit-learn library called Sk-dist. The UNSW-NB15 dataset was used to assess the performance of our system. The results of comparisons made with other existing work have shown that our approach is much better in terms of accuracy, reduction of features and above all fault tolerance

Keywords: Intrusion detection; Machine learning; Big data; Distributed computing; Apache spark; Scikit-learn (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://tafpublications.com/platform/Articles/full-japs5.1.4.php (application/pdf)
https://tafpublications.com/gip_content/paper/Japs-5.1.4.pdf (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:apb:japsss:2019:p:30-36

DOI: 10.20474/japs-5.1.4

Access Statistics for this article

Journal of Applied and Physical Sciences is currently edited by Prof. Vakhrushev Alexander

More articles in Journal of Applied and Physical Sciences from Prof. Vakhrushev Alexander Calle Alarcon 66, Sant Adrian De Besos 08930, Barcelona Spain.
Bibliographic data for series maintained by Prof. Vakhrushev Alexander ().