A Lightweight Malware Detection Model Based on Knowledge Distillation

Chunyu Miao, Liang Kou (), Jilin Zhang and Guozhong Dong ()
Additional contact information
Chunyu Miao: Research Center of Network Application Security, Zhejiang Normal University, Jinhua 321017, China
Liang Kou: College of Cyberspace, Hangzhou Dianzi University, Hangzhou 310005, China
Jilin Zhang: College of Cyberspace, Hangzhou Dianzi University, Hangzhou 310005, China
Guozhong Dong: Pengcheng Laboratory, Department of New Networks, Shenzhen 518066, China

Mathematics, 2024, vol. 12, issue 24, 1-14

Abstract: The extremely destructive nature of malware has become a major threat to Internet security. The research on malware detection techniques has been evolving. Deep learning-based malware detection methods have achieved good results by using large-scale, pre-trained models. However, these models are complex, have large parameters, and require a large amount of hardware resources and have a high inference time cost when applied. To address this challenge, this paper proposes DistillMal, a new method for lightweight malware detection based on knowledge distillation, which improves performance by using a student network to learn valuable cueing knowledge from a teacher network to achieve a lightweight model. We conducted extensive experiments on two new datasets and showed that the student network model’s performance is very close to that of the original model and the outperforms it on some metrics. Our approach helps address the resource constraints and computational challenges faced by traditional deep learning large models. Our research highlights the potential of using knowledge distillation to develop lightweight malware detection models.

Keywords: malware detection; pre-training models; knowledge distillation; lightweight models (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/24/4009/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/24/4009/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:24:p:4009-:d:1548973

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().