A conditional Lindley paradox in Bayesian linear models

Agniva Som, Christopher M Hans and Steven N MacEachern

Biometrika, 2016, vol. 103, issue 4, 993-999

Abstract: The development of prior distributions for Bayesian regression has traditionally been driven by the goal of achieving sensible model selection and parameter estimation. The formalization of properties that characterize good performance has led to the development and popularization of thick-tailed mixtures of g priors such as the Zellner–Siow and hyper-g priors. In this paper we introduce a conditional information asymptotic regime that is motivated by the common data analysis setting where at least one regression coefficient is much larger than the others. We analyse existing mixtures of g priors under this limit and reveal two new phenomena, essentially least-squares estimation and the conditional Lindley paradox, and argue that these are, in general, undesirable. The driver behind both is the use of a single, latent scale parameter common to all coefficients.

Keywords: Bayesian linear model; Information paradox; Lindley’s paradox; Mixture of normal distributions; Model selection; Shrinkage estimator (search for similar items in EconPapers)
Date: 2016
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1093/biomet/asw037 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:biomet:v:103:y:2016:i:4:p:993-999.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

Biometrika is currently edited by Paul Fearnhead

More articles in Biometrika from Biometrika Trust Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK.
Bibliographic data for series maintained by Oxford University Press ().