Bayesian grouping-Gibbs sampling estimation of high-dimensional linear model with non-sparsity

Shanshan Qin, Guanlin Zhang, Yuehua Wu and Zhongyi Zhu

Computational Statistics & Data Analysis, 2025, vol. 203, issue C

Abstract: In high-dimensional linear regression models, common assumptions typically entail sparsity of regression coefficients β∈Rp. However, these assumptions may not hold when the majority, if not all, of regression coefficients are non-zeros. Statistical methods designed for sparse models may lead to substantial bias in model estimation. Therefore, this article proposes a novel Bayesian Grouping-Gibbs Sampling (BGGS) method, which departs from the common sparse assumptions in high-dimensional problems. The BGGS method leverages a grouping strategy that partitions β into distinct groups, facilitating rapid sampling in high-dimensional space. The grouping number (k) can be determined using the ‘Elbow plot’, which operates efficiently and is robust against the initial value. Theoretical analysis, under some regular conditions, guarantees model selection and parameter estimation consistency, and bound for the prediction error. Furthermore, three finite simulations are conducted to assess the competitive advantages of the proposed method in terms of parameter estimation and prediction accuracy. Finally, the BGGS method is applied to a financial dataset to explore its practical utility.

Keywords: Bayesian grouping-Gibbs sampling; Non-sparse; High-dimensional; Linear regression (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167947324001567
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:203:y:2025:i:c:s0167947324001567

DOI: 10.1016/j.csda.2024.108072

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().