Comparing Bayesian Variable Selection to Lasso Approaches for Applications in Psychology

Sierra A. Bainter (), Thomas G. McCauley, Mahmoud M. Fahmy, Zachary T. Goodman, Lauren B. Kupis and J. Sunil Rao
Additional contact information
Sierra A. Bainter: University of Miami
Thomas G. McCauley: University of California San Diego
Mahmoud M. Fahmy: University of Miami
Zachary T. Goodman: University of Miami
Lauren B. Kupis: University of California Los Angeles
J. Sunil Rao: University of Miami

Psychometrika, 2023, vol. 88, issue 3, No 14, 1032-1055

Abstract: Abstract In the current paper, we review existing tools for solving variable selection problems in psychology. Modern regularization methods such as lasso regression have recently been introduced in the field and are incorporated into popular methodologies, such as network analysis. However, several recognized limitations of lasso regularization may limit its suitability for psychological research. In this paper, we compare the properties of lasso approaches used for variable selection to Bayesian variable selection approaches. In particular we highlight advantages of stochastic search variable selection (SSVS), that make it well suited for variable selection applications in psychology. We demonstrate these advantages and contrast SSVS with lasso type penalization in an application to predict depression symptoms in a large sample and an accompanying simulation study. We investigate the effects of sample size, effect size, and patterns of correlation among predictors on rates of correct and false inclusion and bias in the estimates. SSVS as investigated here is reasonably computationally efficient and powerful to detect moderate effects in small sample sizes (or small effects in moderate sample sizes), while protecting against false inclusion and without over-penalizing true effects. We recommend SSVS as a flexible framework that is well-suited for the field, discuss limitations, and suggest directions for future development.

Keywords: Bayesian; regression; lasso; variable selection; penalization; shrinkage priors; stochastic search variable selection (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11336-023-09914-9 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:psycho:v:88:y:2023:i:3:d:10.1007_s11336-023-09914-9

Ordering information: This journal article can be ordered from
http://www.springer. ... gy/journal/11336/PS2

DOI: 10.1007/s11336-023-09914-9

Access Statistics for this article

Psychometrika is currently edited by Irini Moustaki

More articles in Psychometrika from Springer, The Psychometric Society
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().