Parallel inference for big data with the group Bayesian method

Guangbao Guo (), Guoqi Qian, Lu Lin and Wei Shao
Additional contact information
Guangbao Guo: Shandong University of Technology
Guoqi Qian: The University of Melbourne
Lu Lin: Shandong University
Wei Shao: Qufu Normal University

Metrika: International Journal for Theoretical and Applied Statistics, 2021, vol. 84, issue 2, No 5, 225-243

Abstract: Abstract In recent years, big datasets are often split into several subsets due to the storage requirements. We propose a parallel group Bayesian method for statistical inference in sparse big data. This method improves the existing methods in two aspects: the total datasets are also split into a data subset sequence and the parameter vector is divided into several sub-vectors. Besides, we add a weight sequence to optimize the sub-estimators when each of them has a different covariance matrix. We obtain several theoretical properties of the estimator. The results of numerical simulations show that our method is consistent with the theoretical results and is more effective than classic Markov chain Monte Carlo methods.

Keywords: Data subsets; Group Gibbs; Parallel inference; 62F15; 62J12; 62D05 (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00184-020-00784-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:metrik:v:84:y:2021:i:2:d:10.1007_s00184-020-00784-0

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/184/PS2

DOI: 10.1007/s00184-020-00784-0

Access Statistics for this article

Metrika: International Journal for Theoretical and Applied Statistics is currently edited by U. Kamps and Norbert Henze

More articles in Metrika: International Journal for Theoretical and Applied Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().