An Efficient Model Averaging Procedure for Logistic Regression Models Using a Bayesian Estimator with Laplace Prior

Christian Heumann () and Moritz Grenke ()
Additional contact information
Christian Heumann: Ludwig-Maximilians-Universität München, Institut für Statistik
Moritz Grenke: Ludwig-Maximilians-Universität München, Institut für Statistik

A chapter in Statistical Modelling and Regression Structures, 2010, pp 79-90 from Springer

Abstract: Abstract Modern statistics has developed numerous methods for linear and nonlinear regression models, but the correct treatment of model uncertainty is still a difficult task. One approach is model selection, where, usually in a stepwise procedure, an optimal model is searched with respect to some (asymptotic) criterion such as AIC or BIC. A draw back of this approach is, that the reported post model selection estimates, especially for the standard errors of the parameter estimates, are too optimistic. A second approach is model averaging, either frequentist (FMA) or Bayesian (BMA). Here, not an optimal model is searched for, but all possible models are combined by some weighting procedure. Although conceptually easy, the approach has mainly one drawback: the number of potential models can be so large that it is infeasible to calculate the estimates for every possible model. In our paper we extend an idea of Magnus et al. (2009), called WALS, to the case of logistic regression. In principal, the method is not restricted to logistic regression but can be applied to any generalized linear model. In the final stage it uses a Bayesian esimator using a Laplace prior with a special hyperparameter.

Keywords: Model Average; Bayesian Estimator; Bayesian Model Average; Bayesian Model Average; Minimax Regret (search for similar items in EconPapers)
Date: 2010
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-7908-2413-1_5

Ordering information: This item can be ordered from
http://www.springer.com/9783790824131

DOI: 10.1007/978-3-7908-2413-1_5

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().