A Cautionary Note on the Use of Linear Regression for Hypothesis Testing

Gregory L. Light
Additional contact information
Gregory L. Light: Providence College, USA

European Journal of Mathematics and Statistics, 2023, vol. 4, issue 5, 5-7

Abstract: This note draws researchers’ attention to the use of linear regression for the purpose of conducting a hypothesis testing. Even when multiple explanatory variables are included in a regression equation to preclude the hazard of a simple regression of omitting other factors, multicollinearity unfortunately is inherent in multiple regression simply because the included explanatory variables can share some common parameter domain; that is, they co-vary. Here we shall show that however one transforms the variance-covariance matrix of the least-squares estimation to reduce the estimation errors, the procedure amounts to affine transformations of the explanatory variables so that despite the transformation they remain to co-vary, rendering the coefficient as a partial derivative invalid. The root of this problem originates from the fact that one receives the explanatory variables’ values by observation rather than predetermining their values and then collecting the corresponding dependent variable’ values. This situation becomes especially disconcerting when a transformed explanatory variable has its estimated coefficient enjoying an exceptional degree of confidence but of no mathematical status as a partial derivative, misleading engineering or medical prescriptions and public policies.

Keywords: Model misspecification; multicollinearity; orthogonalization; ridge regression (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
https://eu-opensci.org/index.php/ejmath/article/view/14268 Abstract page (text/html)
https://eu-opensci.org/index.php/ejmath/article/download/14268/3228 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:epw:ejmath:v:4:y:2023:i:5:id:14268

DOI: 10.24018/ejmath.2023.4.5.268

Access Statistics for this article

More articles in European Journal of Mathematics and Statistics from European Open Science
Bibliographic data for series maintained by Support Team ().