 Renewable estimation and incremental inference in generalized linear models with streaming data setsLan Luo and Peter X.‐K. Song Journal of the Royal Statistical Society Series B, 2020, vol. 82, issue 1, 69-97 Abstract: The paper presents an incremental updating algorithm to analyse streaming data sets using generalized linear models. The method proposed is formulated within a new framework of renewable estimation and incremental inference, in which the maximum likelihood estimator is renewed with current data and summary statistics of historical data. Our framework can be implemented within a popular distributed computing environment, known as Apache Spark, to scale up computation. Consisting of two data‐processing layers, the rho architecture enables us to accommodate inference‐related statistics and to facilitate sequential updating of the statistics used in both estimation and inference. We establish estimation consistency and asymptotic normality of the proposed renewable estimator, in which the Wald test is utilized for an incremental inference. Our methods are examined and illustrated by various numerical examples from both simulation experiments and a real world data analysis. Date: 2020 Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:82:y:2020:i:1:p:69-97 Ordering information: This journal article can be ordered from Access Statistics for this article Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC. |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.