Multi-label feature selection considering label importance-weighted relevance and label-dependency redundancy

Xi-Ao Ma, Haibo Liu, Yi Liu and Justin Zuopeng Zhang

European Journal of Operational Research, 2025, vol. 322, issue 1, 215-236

Abstract: Information theory has emerged as a prominent approach for analyzing feature relevance and redundancy in multi-label feature selection. However, traditional information theory-based methods encounter two primary issues. Firstly, when evaluating feature relevance, they fail to consider the differing importance of each label within the entire label set. Secondly, when assessing feature redundancy, they overlook the varying dependencies of the selected features on the labels. To address these issues, this paper proposes a novel multi-label feature selection method that considers label importance-weighted relevance and label-dependency redundancy. Specifically, we introduce the concept of label importance weight (LIW) to measure the significance of each label within the entire label set. Based on this LIW, we define a feature relevance term called label importance-weighted relevance (LIWR). Subsequently, we leverage the uncertainty coefficient to quantify the dependence of the selected features on the labels, treating it as a weight. Building upon this weight, we establish a feature redundancy term known as label-dependency redundancy (LDR). Finally, we formulate a feature evaluation criterion called LIWR-LDR by maximizing LIWR and minimizing LDR, accompanied by the presentation of a corresponding feature selection algorithm. Extensive experiments conducted on 25 multi-label datasets demonstrate the effectiveness of LIWR-LDR.

Keywords: Machine learning; Multi-label feature selection; Information theory; Label importance; Uncertainty coefficient (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0377221724009287
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ejores:v:322:y:2025:i:1:p:215-236

DOI: 10.1016/j.ejor.2024.11.038

Access Statistics for this article

European Journal of Operational Research is currently edited by Roman Slowinski, Jesus Artalejo, Jean-Charles. Billaut, Robert Dyson and Lorenzo Peccati

More articles in European Journal of Operational Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().