Logistic Regression in Cases of Separation by Means of Penalized Maximum Likelihood Estimation

Joseph Coveney ()
Additional contact information
Joseph Coveney: Cobridge Co., Ltd.

Summer North American Stata Users' Group Meetings 2008 from Stata Users Group

Abstract: Users of –logit- or –logistic- occasionally encounter instances in which one or more predictors perfectly predict one or both outcomes (a condition called separation), or in which some outcomes are completely determined (quasicomplete separation). Finite maximum likelihood estimates do not exist under conditions of separation. Exact logistic regression with –exlogistic- can serve as an alternative in these circumstances, but is sometimes not feasible. In the 1990s, David Firth proposed a type of penalization for reducing bias of maximum likelihood estimates in generalized linear models by means of modifying the score equations. Firth’s method has the interpretation of penalized maximum likelihood when the canonical link function is used, such as in logistic regression. In this decade, Georg Heinze and colleagues have explored this technique as a solution to the problem of separation in logistic regression. A Stata implementation, -firthlogit-, which maximizes the log penalized likelihood using –ml-, is described here. Model fitting and predictions, inference with penalized likelihood ratio tests, and construction of profile penalized likelihood confidence intervals is illustrated using examples where –logit- and –logistic- either balk or do not give finite maximum likelihood estimates, and where exact logistic regression is problematic because of memory requirements or degenerate conditional distributions.

Date: 2008-07-29, Revised 2008-09-24
New Economics Papers: this item is included in nep-ore
References: Add references at CitEc
Citations:

Downloads: (external link)
http://repec.org/snasug08/coveney_snasug08.pps presentation slides (application/x-ms-powerpoint)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:boc:nsug08:10

Access Statistics for this paper

More papers in Summer North American Stata Users' Group Meetings 2008 from Stata Users Group Contact information at EDIRC.
Bibliographic data for series maintained by Christopher F Baum ().