Influence measure based on probabilistic behavior of regression estimators

Myung Kim ()

Computational Statistics, 2015, vol. 30, issue 1, 97-105

Abstract: An influence measure for investigating the influence of deleting an observation in linear regression is proposed based on geometric thoughts of the sampling distribution of the distance between two estimators of regression coefficients computed with and without a single specific observation. The covariance matrix of the above sampling distribution plays a key role in deriving the influence measure. It turns out that geometrically, this distance is distributed entirely along the axis associated with the nonnull eigenvalue of the covariance matrix. The deviation of the regression coefficients computed without an observation from the regression coefficients computed with the full data is reflected in the eigenvalue of the covariance matrix which can be used for investigating the influence. The distance is normalized using the associated covariance matrix and this normalized distance turns out to be the square of internally studentized residuals. Illustrative examples for showing the effectiveness of the influence measure proposed here are given. In judging the influence of observations on the least squares estimates of regression coefficients, Cook’s distance does not work well for one example and therefore we should be cautious about a blind use of the Cook’s distance. Copyright Springer-Verlag Berlin Heidelberg 2015

Keywords: Cook’s distance; Covariance matrix; Eigen analysis; Influence (search for similar items in EconPapers)
Date: 2015
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1007/s00180-014-0524-z (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:compst:v:30:y:2015:i:1:p:97-105

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/180/PS2

DOI: 10.1007/s00180-014-0524-z

Access Statistics for this article

Computational Statistics is currently edited by Wataru Sakamoto, Ricardo Cao and Jürgen Symanzik

More articles in Computational Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().