Alleviating conditional independence assumption of naive Bayes

Xu-Qing Liu (), Xiao-Cai Wang, Li Tao, Feng-Xian An and Gui-Ren Jiang
Additional contact information
Xu-Qing Liu: Huaiyin Institute of Technology
Xiao-Cai Wang: Huaiyin Institute of Technology
Li Tao: Huaiyin Institute of Technology
Feng-Xian An: Huaiyin Institute of Technology
Gui-Ren Jiang: Huaiyin Institute of Technology

Statistical Papers, 2024, vol. 65, issue 5, No 8, 2835-2863

Abstract: Abstract In this paper, we consider the problem of how to alleviate the conditional independence assumption of naive Bayes. We try to find an equivalent set of variables for the attributes of the class such that these variables are nearly conditionally independent. For the case that all attributes are continuous variables, we put forward the theory of class-weighting supervised principal component analysis (CWSPCA) to improve naive Bayes. For the categorical case, we construct the equivalent variables by rearranging the values of the attributes, and propose the decremental association rearrangement (DAR) algorithm and its multiple version (MDAR). Finally, we make a benchmarking study to show the performance of our methods. The experimental results reveal that naive Bayes can be greatly improved by means of properly transforming the original attributes.

Keywords: Naive Bayes (NB); Conditional Independence Assumption (CIA); Class-weighting supervised principal component analysis (CWSPCA); Multiple decremental association rearrangement (MDAR) (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00362-023-01474-5 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stpapr:v:65:y:2024:i:5:d:10.1007_s00362-023-01474-5

Ordering information: This journal article can be ordered from
http://www.springer. ... business/journal/362

DOI: 10.1007/s00362-023-01474-5

Access Statistics for this article

Statistical Papers is currently edited by C. Müller, W. Krämer and W.G. Müller

More articles in Statistical Papers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().