A VIF-based optimization model to alleviate collinearity problems in multiple linear regression

Yow-Jen Jou (), Chien-Chia Huang () and Hsun-Jung Cho ()

Computational Statistics, 2014, vol. 29, issue 6, 1515-1541

Abstract: In this paper, we address data collinearity problems in multiple linear regression from an optimization perspective. We propose a novel linearly constrained quadratic programming model, based on the concept of the variance inflation factor (VIF). We employ the perturbation method that involves imposing a general symmetric non-diagonal perturbation matrix on the correlation matrix. The proposed VIF-based model reduces the largest VIF by minimizing the resulting biases. The VIF-based model can mitigate the harm from data collinearity through the reduction in both the condition number and VIFs, meanwhile improving the statistical significance. The resulting estimator has bounded biases under an iterative framework and hence is termed the least accumulative bias estimator. Certain potential statistical properties can be further considered as the side constraints for the proposed model. Various numerical examples validate the proposed approach. Copyright Springer-Verlag Berlin Heidelberg 2014

Keywords: Multicollearity; Variance inflation factor; Convex optimization (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
http://hdl.handle.net/10.1007/s00180-014-0504-3 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:compst:v:29:y:2014:i:6:p:1515-1541

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/180/PS2

DOI: 10.1007/s00180-014-0504-3

Access Statistics for this article

Computational Statistics is currently edited by Wataru Sakamoto, Ricardo Cao and Jürgen Symanzik

More articles in Computational Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().