Performance Evaluation of a Smart Intrusion Detection System (IDS) Model

Shah Md. Istiaque, Asif Iqbal Khan, Zaber Al Hassan and Sajjad Waheed
Additional contact information
Shah Md. Istiaque: Bangladesh University of Professionals, Bangladesh
Asif Iqbal Khan: Mawlana Bhashani Science and Technology University, Bangladesh
Zaber Al Hassan: Chottogram University of Engineering & Technology, Bangladesh
Sajjad Waheed: Mawlana Bhashani Science and Technology University, Bangladesh

European Journal of Engineering and Technology Research, 2021, vol. 6, issue 2, 148-152

Abstract: The research work titled “Smart Intrusion Detection System Comprised of Machine Learning and Deep Learning” was published in European Journal for Engineering and Technology Research (EJERS) online journal in the October edition where a smart IDS model was proposed. In this present work, validation of the IDS model is conducted. KDD Cup'99 intrusion detection dataset was used to build the IDS model. A unique method is incorporated to test the performance of the model. Here, training is conducted by using the KDD'99 dataset. But testing is done through the NSL-KDD dataset. Testing is conducted in three-stage. In the first stage, using generic 41 features the accuracy, sensitivity, and FPR of detecting attack was 95.240%, 93.103%, 1.936% respectively for Random Forest and for MLP it is 87.811%, 90.065%, and 15.168% respectively. In the second stage selective 15 features are used where accuracy, sensitivity, and FPR of detecting attack is 70.808%, 81.992%, 43.971% respectively for Random Forest and for MLP it is 67.637%, 87.660%, 54.266% respectively. In the third stage selective 22 features are used where accuracy, sensitivity, and FPR of detecting attack is 97.001%, 96.643%, 2.272% for Random Forest respectively and for MLP it is 85.442%, 82.350 and 10.472 respectively. Total 3,11,021 record is used for training and 22,544 record is used for testing purpose. The final accuracy, sensitivity and FPR of the model can be resulted as 95.24%, 70.808%, 96.988% for 41 features, 93.103%, 87.68%, 97.233% for 15 features, 1.936%, 43.97%, 3.36% for 22 features. Therefore, the IDS model is efficient and effective.

Keywords: Intrusion Detection System; Random Forest; Back- Propagation based MLP; KDD'99 & NSL-KDD (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
https://eu-opensci.org/index.php/ejeng/article/view/62371 Abstract page (text/html)
https://eu-opensci.org/index.php/ejeng/article/download/62371/12606 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:epw:ejeng0:v:6:y:2021:i:2:id:62371

DOI: 10.24018/ejeng.2021.6.2.2371

Access Statistics for this article

More articles in European Journal of Engineering and Technology Research from European Open Science
Bibliographic data for series maintained by Support ().