Practical Challenges and Recommendations of Filter Methods for Feature Selection

Mohammed Rajab () and Dennis Wang
Additional contact information
Mohammed Rajab: Department of Computer Science, The University of Sheffield, Sheffield, UK
Dennis Wang: Department of Computer Science, The University of Sheffield, Sheffield, UK2Sheffield Institute for Translational Neuroscience, Sheffield, UK3NIHR Sheffield Biomedical Research Centre, Sheffield, UK

Journal of Information & Knowledge Management (JIKM), 2020, vol. 19, issue 01, 1-15

Abstract: Feature selection, the process of identifying relevant features to be incorporated into a proposed model, is one of the significant steps of the learning process. It removes noise from the data to increase the learning performance while reducing the computational complexity. The literature review indicated that most previous studies had focused on improving the overall classifier performance or reducing costs associated with training time during building of the classifiers. However, in this era of big data, there is an urgent need to deal with more complex issues that makes feature selection, especially using filter-based methods, more challenging; this in terms of dimensionality, data structures, data format, domain experts’ availability, data sparsity, and result discrepancies, among others. Filter methods identify the informative features of a given dataset to establish various predictive models using mathematical models. This paper takes a new route in an attempt to pinpoint recent practical challenges associated with filter methods and discusses potential areas of development to yield better performance. Several practical recommendations, based on recent studies, are made to overcome the identified challenges and make the feature selection process simpler and more efficient.

Keywords: Feature selection; filter methods; machine learning; data imbalance; ranking methods (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.worldscientific.com/doi/abs/10.1142/S0219649220400195
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:jikmxx:v:19:y:2020:i:01:n:s0219649220400195

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219649220400195

Access Statistics for this article

Journal of Information & Knowledge Management (JIKM) is currently edited by Professor Suliman Hawamdeh

More articles in Journal of Information & Knowledge Management (JIKM) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().