Closed-form estimators for multivariate regressions models -a single categorical variable approach

Antoine Burg () and Christophe Dutang ()
Additional contact information
Antoine Burg: CEREMADE - CEntre de REcherches en MAthématiques de la DEcision - Université Paris Dauphine-PSL - PSL - Université Paris Sciences et Lettres - CNRS - Centre National de la Recherche Scientifique, SCOR SE [Paris]
Christophe Dutang: ASAR - Applied Statistics And Reliability - ASAR - LJK - Laboratoire Jean Kuntzmann - Inria - Institut National de Recherche en Informatique et en Automatique - CNRS - Centre National de la Recherche Scientifique - UGA - Université Grenoble Alpes - Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology - UGA - Université Grenoble Alpes

Post-Print from HAL

Abstract: The maximum likelihood estimator (MLE) remains the most frequently used method to estimate the parameters of generalized linear models. But even for distributions within the exponential family, MLEs are not always tractable and need to be computed with time consuming numerical methods like the Iterative Weighted Least Square algorithm. In order to improve the computation time, closed-form estimators have been found in case of categorical explanatory variables for univariate random variables of one-parameter exponential type. In the context of multivariate generalized linear models (MGLM), we propose a new way to look at the score in case of single categorical variables for any distribution in the exponential family. Firstly, we derive closed-form MLE for MGLM assuming multinomial and negative multinomial distributions. Secondly, we deduce similar results for the multivariate normal distributions. For the Dirichlet distribution, we propose a closed-form estimator, yet not MLE, for which we prove the consistency. We illustrate the computation time gains on simulated datasets: closed-form estimators are about 1000 times faster, especially for high dimension. Closed-form estimators are computed in constant times.. Finally, we show the relevancy of the proposed estimator on real-world datasets by modeling cause-of-death mortality in US. We are able to catch the first-order effects of covid between 2019 and 2021.

Keywords: maximum likelihood estimation; multi-parameter exponential family; closed-form estimators; computation time; actuarial mortality model (search for similar items in EconPapers)
Date: 2026-02-28
New Economics Papers: this item is included in nep-dcm and nep-ecm
Note: View the original document on HAL open archive server: https://hal.science/hal-05539060v1
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in Computational Statistics, 2026, 41 (3), pp.50. ⟨10.1007/s00180-025-01679-2⟩

Downloads: (external link)
https://hal.science/hal-05539060v1/document (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hal:journl:hal-05539060

DOI: 10.1007/s00180-025-01679-2

Access Statistics for this paper

More papers in Post-Print from HAL
Bibliographic data for series maintained by CCSD ().