Separation-Resistant and Bias-Reduced Logistic Regression: STATISTICA Macro
Kamil Fijorek and
Andrzej Sokolowski
Journal of Statistical Software, 2012, vol. 047, issue c02
Abstract:
Logistic regression is one of the most popular techniques used to describe the relationship between a binary dependent variable and a set of independent variables. However, the application of logistic regression to small data sets is often hindered by the complete or quasicomplete separation. Under the separation scenario, results obtained via maximum likelihood should not be trusted, since at least one parameter estimate diverges to infinity. Firth's approach to logistic regression is a theoretically sound procedure, which is guaranteed to arrive at finite estimates even in a separation case. Firth's procedure was also proved to significantly reduce the small sample bias of maximum likelihood estimates. The main goal of the paper is to introduce the STATISTICA macro, which performs Firth-type logistic regression.
Date: 2012-04-17
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)
Downloads: (external link)
https://www.jstatsoft.org/index.php/jss/article/view/v047c02/v47c02.pdf
https://www.jstatsoft.org/index.php/jss/article/do ... v047c02/SR_BR_LR.svb
https://www.jstatsoft.org/index.php/jss/article/do ... 7c02-replication.zip
https://www.jstatsoft.org/index.php/jss/article/do ... ile/v047c02/v47c02.R
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:jss:jstsof:v:047:c02
DOI: 10.18637/jss.v047.c02
Access Statistics for this article
Journal of Statistical Software is currently edited by Bettina Grün, Edzer Pebesma and Achim Zeileis
More articles in Journal of Statistical Software from Foundation for Open Access Statistics
Bibliographic data for series maintained by Christopher F. Baum ().