Novel Approach to Choosing Principal Components Number in Logistic Regression

Borislava Vrigazova

A chapter in Proceedings of the ENTRENOVA - ENTerprise REsearch InNOVAtion Conference, Hybrid Conference, Zagreb, Croatia, 9-10 September 2021, 2021, pp 1-12 from IRENET - Society for Advancing Innovation and Research in Economy, Zagreb

Abstract: The confirmed approach to choosing the number of principal components for prediction models includes exploring the contribution of each principal component to the total variance of the target variable. A combination of possible important principal components can be chosen to explain a big part of the variance in the target. Sometimes several combinations of principal components should be explored to achieve the highest accuracy in classification. This research proposes a novel automatic way of deciding how many principal components should be retained to improve classification accuracy. We do that by combining principal components with the ANOVA selection. To improve the accuracy resulting from our automatic approach, we use the bootstrap procedure for model selection. We call this procedure the Bootstrapped-ANOVA PCA selection. Our results suggest that this procedure can automate the principal components selection and improve the accuracy of classification models, in our example, the logistic regression.

Keywords: ANOVA; PCA; Bootstrap; logistic regression (search for similar items in EconPapers)
JEL-codes: C38 C52 C63 (search for similar items in EconPapers)
Date: 2021
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/262229/1/01-ENT-2021.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:entr21:262229

DOI: 10.54820/PUCR5250

Access Statistics for this chapter

More chapters in Proceedings of the ENTRENOVA - ENTerprise REsearch InNOVAtion Conference (2021), Hybrid Conference, Zagreb, Croatia from IRENET - Society for Advancing Innovation and Research in Economy, Zagreb
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().