A goodness-of-fit measure for logistic regression under separation
Naoki Kotani,
Takeshi Kurosawa and
Nobuoki Eshima
Communications in Statistics - Theory and Methods, 2025, vol. 54, issue 13, 4083-4100
Abstract:
Logistic regression models have a severe problem called separation. The maximum likelihood estimator does not exist in logistic regression models for data structures under separation. Under separation, the forcibly estimated maximum likelihood estimate may have an extremely large value. Separation often occurs when the size of dataset is small. Consequently, goodness-of-fit measures based on the likelihood ratio and those based on covariance functions using the maximum likelihood estimate indicate that the model is excessively good regardless of the cause of the separation. The Firth and exact logistic regression methods are valid estimation methods for separation problems. Therefore, we propose methods to reasonably evaluate the goodness-of-fit measures of statistical models under separation with dataset of a small sample size with the abovementioned methods. The goodness-of-fit measures based on covariance functions which are a generalization of the multiple correlation coefficient, referred to as the regression correlation coefficient and the entropy coefficient of determination are then used combined with the abovementioned methods for the separation data. In addition, we conducted a data analysis using the definition of the non separation ratio based on the regression depth.
Date: 2025
References: Add references at CitEc
Citations:
Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2024.2413845 (text/html)
Access to full text is restricted to subscribers.
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:54:y:2025:i:13:p:4083-4100
Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20
DOI: 10.1080/03610926.2024.2413845
Access Statistics for this article
Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe
More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().