A Comparison of Bayesian and Frequentist Variable Selection Methods for Estimating Average Treatment Effects in Logistic Regression

Alex H. Martinez, Brian Christensen, Elizabeth F. Sutton and Andrew G. Chapple

EERI Research Paper Series from Economics and Econometrics Research Institute (EERI), Brussels

Abstract: In many manuscripts, researchers use multivariable logistic regression to adjust for potential confounding variables when estimating a direct relationship of a treatment or exposure on a binary outcome. After choosing how variables are entered into that model, researchers can calculate an estimated average treatment effect (ATE), or the estimated change in the outcome probability with and without an exposure present. Which potential confounding variables should be included in that logistic regression model is often a concern, which is sometimes determined from variable selection methods. We explore how forward, backward, and stepwise confounding variable selection estimate the ATE compared to spike-and-slab Bayesian variable selection across 1,000 randomly generated scenarios and various sample sizes. Our large simulation study allow us to make pseudo-theoretical conclusions about which methods perform best for different sample sizes, rarities of coutcomes, and number of confounders. An R package is also described to implement variable selection on the confounding variables only and provide estimates of the ATE. Overall, results suggest that Bayesian variable selection is more appealing in smaller sample sizes than frequentist variable selection methods in terms of estimating the ATE. Differences are minimal in larger sample sizes.

Keywords: Average Treatment Effect; ATE; Bayesian; Frequentist; Variable Selection (search for similar items in EconPapers)
JEL-codes: C01 C11 C21 (search for similar items in EconPapers)
Date: 2025-03-01
New Economics Papers: this item is included in nep-ecm and nep-inv
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.eeri.eu/documents/wp/EERI_RP_2025_01.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eei:rpaper:eeri_rp_2025_01

Access Statistics for this paper

More papers in EERI Research Paper Series from Economics and Econometrics Research Institute (EERI), Brussels Contact information at EDIRC.
Bibliographic data for series maintained by Julia van Hove ().