Deep Anomaly Detection Based on Variational Deviation Network

Junwen Lu, Jinhui Wang, Xiaojun Wei, Keshou Wu and Guanfeng Liu
Additional contact information
Junwen Lu: School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China
Jinhui Wang: School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China
Xiaojun Wei: School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China
Keshou Wu: School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China
Guanfeng Liu: School of Computer and Information and Engineering, Xiamen University of Technology, Xiamen 361024, China

Future Internet, 2022, vol. 14, issue 3, 1-17

Abstract: There is relatively little research on deep learning for anomaly detection within the field of deep learning. Existing deep anomaly detection methods focus on the learning of feature reconstruction, but such methods mainly learn new feature representations, and the new features do not fully reflect the original features, leading to inaccurate anomaly scores; in addition, there is an end-to-end deep anomaly detection algorithm, but the method cannot accurately obtain a reference score that matches the data themselves. In addition, in most practical scenarios, the data are unlabeled, and there exist some datasets with labels, but the confidence and accuracy of the labels are very low, resulting in inaccurate results when put into the model, which makes them often designed for unsupervised learning, and thus in such algorithms, the prior knowledge of known anomalous data is often not used to optimize the anomaly scores. To address the two problems raised above, this paper proposes a new anomaly detection model that learns anomaly scores mainly through a variational deviation network (i.e., not by learning the reconstruction error of new features, distance metrics, or random generation, but by learning the normal distribution of normal data). In this model, we force the anomaly scores to deviate significantly from the normal data by a small amount of anomalous data and a reference score generated by variational self-encoding. The experimental results in multiple classes of data show that the new variational deviation network proposed in this paper has higher accuracy among the mainstream anomaly detection algorithms.

Keywords: anomaly detection; variational auto-encoder; deep learning; semi-supervised learning (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/14/3/80/pdf (application/pdf)
https://www.mdpi.com/1999-5903/14/3/80/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:14:y:2022:i:3:p:80-:d:766902

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().