robROSE: A robust approach for dealing with imbalanced data in fraud detection
Bart Baesens (),
Sebastiaan Höppner (),
Irene Ortner () and
Tim Verdonck ()
Additional contact information
Bart Baesens: KU Leuven
Sebastiaan Höppner: KU Leuven
Irene Ortner: Applied Statistics GmbH
Tim Verdonck: University of Antwerp
Statistical Methods & Applications, 2021, vol. 30, issue 3, No 5, 861 pages
Abstract:
Abstract A major challenge when trying to detect fraud is that the fraudulent activities form a minority class which make up a very small proportion of the data set. In most data sets, fraud occurs in typically less than $$0.5\%$$ 0.5 % of the cases. Detecting fraud in such a highly imbalanced data set typically leads to predictions that favor the majority group, causing fraud to remain undetected. We discuss some popular oversampling techniques that solve the problem of imbalanced data by creating synthetic samples that mimic the minority class. A frequent problem when analyzing real data is the presence of anomalies or outliers. When such atypical observations are present in the data, most oversampling techniques are prone to create synthetic samples that distort the detection algorithm and spoil the resulting analysis. A useful tool for anomaly detection is robust statistics, which aims to find the outliers by first fitting the majority of the data and then flagging data observations that deviate from it. In this paper, we present a robust version of ROSE, called robROSE, which combines several promising approaches to cope simultaneously with the problem of imbalanced data and the presence of outliers. The proposed method achieves to enhance the presence of the fraud cases while ignoring anomalies. The good performance of our new sampling technique is illustrated on simulated and real data sets and it is shown that robROSE can provide better insight in the structure of the data. The source code of the robROSE algorithm is made freely available.
Keywords: Fraud analysis; Skewed data; Outliers; Oversampling; Binary classification (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)
Downloads: (external link)
http://link.springer.com/10.1007/s10260-021-00573-7 Abstract (text/html)
Access to the full text of the articles in this series is restricted.
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:spr:stmapp:v:30:y:2021:i:3:d:10.1007_s10260-021-00573-7
Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10260/PS2
DOI: 10.1007/s10260-021-00573-7
Access Statistics for this article
Statistical Methods & Applications is currently edited by Tommaso Proietti
More articles in Statistical Methods & Applications from Springer, Società Italiana di Statistica
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().