The Influence of Unbalanced Economic Data on Feature Selection and Quality of Classifiers

Kubus Mariusz ()
Additional contact information
Kubus Mariusz: Opole University of Technology, Faculty of Production Engineering and Logistic, Department of Mathematics and Applied Computer Science, Sosnkowskiego 31, 45-272Opole, Poland

Folia Oeconomica Stetinensia, 2020, vol. 20, issue 1, 232-247

Abstract: Research background: The successful learning of classifiers depends on the quality of data. Modeling is especially difficult when the data are unbalanced or contain many irrelevant variables. This is the case in many applications. The classification of rare events is the overarching goal, e.g. in bankruptcy prediction, churn analysis or fraud detection. The problem of irrelevant variables accompanies situations where the specification of the model is not known a priori, thus in typical conditions for data mining analysts.Purpose: The purpose of this paper is to compare the combinations of the most popular strategies of handling unbalanced data with feature selection methods that represent filters, wrappers and embedded methods.Research methodology: In the empirical study, we use real datasets with additionally introduced irrelevant variables. In this way, we are able to recognize which method correctly eliminates irrelevant variables.Results: Having carried out the experiment we conclude that over-sampling does not work in connection with feature selection. Some recommendations of the most promising methods also are given.Novelty: There are many solutions proposed in the literature concerning unbalanced data as well as feature selection. The innovative field of our interests is to examine their interactions.

Keywords: classifiers; class unbalance; sensitivity; feature selection; resampling (search for similar items in EconPapers)
JEL-codes: C1 C38 C52 (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.2478/foli-2020-0014 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrs:foeste:v:20:y:2020:i:1:p:232-247:n:14

DOI: 10.2478/foli-2020-0014

Access Statistics for this article

Folia Oeconomica Stetinensia is currently edited by Waldemar Tarczyński

More articles in Folia Oeconomica Stetinensia from Sciendo
Bibliographic data for series maintained by Peter Golla ().