AN IN-DEPTH LOOK AT HIGHEST POSTERIOR MODEL SELECTION

Tanujit Dey, Hemant Ishwaran and J. Sunil Rao

Econometric Theory, 2008, vol. 24, issue 02, pages 377-403

Abstract: We consider the properties of the highest posterior probability model in a linear regression setting. Under a spike and slab hierarchy we find that although highest posterior model selection is total risk consistent, it possesses hidden undesirable properties. One such property is a marked underfitting in finite samples, a phenomenon well noted for Bayesian information criterion (BIC) related procedures but not often associated with highest posterior model selection. Another concern is the substantial effect the prior has on model selection. We employ a rescaling of the hierarchy and show that the resulting rescaled spike and slab models mitigate the effects of underfitting because of a perfect cancellation of a BIC-like penalty term. Furthermore, by drawing upon an equivalence between the highest posterior model and the median model, we find that the effect of the prior is less influential on model selection, as long as the underlying true model is sparse. Nonsparse settings are, however, problematic. Using the posterior mean for variable selection instead of posterior inclusion probabilities avoids these issues.

Date: 2008

Downloads: (external link)
http://journals.cambridge.org/abstract_S026646660808016X link to article abstract page (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: http://EconPapers.repec.org/RePEc:cup:etheor:v:24:y:2008:i:02:p:377-403_08

Access Statistics for this article

More articles in Econometric Theory from Cambridge University Press
Address: The Edinburgh Building, Shaftesbury Road, Cambridge CB2 2RU UK
Series data maintained by Mike Eden ().