Robust Bayesian approach to logistic regression modeling in small sample size utilizing a weakly informative student’s t prior distribution

Kenneth Chukwuemeka Asanya, Mohamed Kharrat, Akaninyene Udo Udom and Emmanuel Torsen

Communications in Statistics - Theory and Methods, 2023, vol. 52, issue 2, 283-293

Abstract: This work discourages using the logistic regression (LR) model for estimative purposes when the sample size is small. We propose a new model called the “Robust Bayesian Logistic (RBL) model” that minimizes bias in the estimated logistic regression coefficients when the sample size is small, and covariate corruption is suspected. For the prior specification in the proposed RBL model, all the logistic regression coefficients are assigned independent Student’s t-distribution with the location parameter 0, scale parameter 1, and degree of freedom 7 for the constant term and degree of freedom of 1 for all other regression coefficients. In our experimental study, the proposed RBL model outperforms the Logistic Regression (LR) model by having a lower mean squared error (MSE) in the regression coefficients estimated for all the sample sizes considered. The proposed RBL model has a lower standard deviation than the LR model for all the estimated regression coefficients on the real-life dataset. We suggest that the proposed RBL model be considered for logistic modeling since it generates stable, consistent, and reliable estimates, especially when the sample size is small. The proposed RBL model is a fully Bayesian method implemented in the R environment using the RJAGS package.

Date: 2023
References: Add references at CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2021.1912767 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:52:y:2023:i:2:p:283-293

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2021.1912767

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().