Model selection using PRESS statistic

Ida Marie Alcantara (), Joshua Naranjo () and Yanda Lang ()
Additional contact information
Ida Marie Alcantara: Western Washington University
Joshua Naranjo: Western Michigan University
Yanda Lang: Temple University

Computational Statistics, 2023, vol. 38, issue 1, No 14, 285-298

Abstract: Abstract The most popularly used statistic $$R^2$$ R 2 has a fundamental weakness in model building: it favors adding more predictors to the model because $$R^2$$ R 2 can only increase. In effect, additional predictors start fitting noise to the data. Other measures used in selecting a regression model such as $$R^2_{adj}$$ R adj 2 , AIC, SBC, and Mallow’s $$C_p$$ C p does not guarantee that the model selected will also make better prediction of future values. To avoid this, data scientists withhold a percentage of the data for validation purposes. The PRESS statistic does something similar by withholding each observation in calculating its own predicted value. In this paper, we investigated the behavior of $$R^2_{PRESS}$$ R PRESS 2 , and how it performs compared to other criterion in model selection in the presence of unnecessary predictors. Using simulated data, we found $$R^2_{PRESS}$$ R PRESS 2 has generally performed best in selecting the true model as the best model for prediction among the model selection measures considered.

Keywords: PRESS statistic; Model selection; Prediction (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00180-022-01228-1 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:compst:v:38:y:2023:i:1:d:10.1007_s00180-022-01228-1

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/180/PS2

DOI: 10.1007/s00180-022-01228-1

Access Statistics for this article

Computational Statistics is currently edited by Wataru Sakamoto, Ricardo Cao and Jürgen Symanzik

More articles in Computational Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().