Assessing the goodness of fit of logistic regression models in large samples: A modification of the Hosmer‐Lemeshow test

Giovanni Nattino, Michael L. Pennell and Stanley Lemeshow

Biometrics, 2020, vol. 76, issue 2, 549-560

Abstract: Evaluating the goodness of fit of logistic regression models is crucial to ensure the accuracy of the estimated probabilities. Unfortunately, such evaluation is problematic in large samples. Because the power of traditional goodness of fit tests increases with the sample size, practically irrelevant discrepancies between estimated and true probabilities are increasingly likely to cause the rejection of the hypothesis of perfect fit in larger and larger samples. This phenomenon has been widely documented for popular goodness of fit tests, such as the Hosmer‐Lemeshow test. To address this limitation, we propose a modification of the Hosmer‐Lemeshow approach. By standardizing the noncentrality parameter that characterizes the alternative distribution of the Hosmer‐Lemeshow statistic, we introduce a parameter that measures the goodness of fit of a model but does not depend on the sample size. We provide the methodology to estimate this parameter and construct confidence intervals for it. Finally, we propose a formal statistical test to rigorously assess whether the fit of a model, albeit not perfect, is acceptable for practical purposes. The proposed method is compared in a simulation study with a competing modification of the Hosmer‐Lemeshow test, based on repeated subsampling. We provide a step‐by‐step illustration of our method using a model for postneonatal mortality developed in a large cohort of more than 300 000 observations.

Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
https://doi.org/10.1111/biom.13249

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:biomet:v:76:y:2020:i:2:p:549-560

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0006-341X

Access Statistics for this article

More articles in Biometrics from The International Biometric Society
Bibliographic data for series maintained by Wiley Content Delivery ().