High‐dimensional prediction for count response via sparse exponential weights

The Tien Mai

Statistica Neerlandica, 2025, vol. 79, issue 4

Abstract: Count data is prevalent in various fields such as ecology, medical and genomics research. In high‐dimensional settings, where the number of features exceeds the sample size, feature selection becomes essential. While frequentist methods like Lasso have advanced in handling high‐dimensional count data, Bayesian approaches remain underexplored with no theoretical results on prediction performance. This article introduces a novel probabilistic machine learning framework for high‐dimensional count data prediction. We propose a pseudo‐Bayesian method that integrates a scaled Student prior to promote sparsity and uses an exponential weight aggregation procedure. A key contribution is a novel risk measure tailored to count data prediction, with theoretical guarantees for prediction risk using PAC‐Bayesian bounds. Our results include nonasymptotic oracle inequalities, demonstrating rate‐optimal prediction error without prior knowledge of sparsity. We implement this approach efficiently using Langevin Monte Carlo method. Simulations and a real data application highlight the strong performance of our method compared to the Lasso in various settings.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/stan.70013

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:stanee:v:79:y:2025:i:4:n:e70013

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0039-0402

Access Statistics for this article

Statistica Neerlandica is currently edited by Miroslav Ristic, Marijtje van Duijn and Nan van Geloven

More articles in Statistica Neerlandica from Netherlands Society for Statistics and Operations Research
Bibliographic data for series maintained by Wiley Content Delivery ().