A short note on fitting a single-index model with massive data

Rong Jiang and Yexun Peng

Statistical Theory and Related Fields, 2023, vol. 7, issue 1, 49-60

Abstract: This paper studies the inference problem of index coefficient in single-index models under massive dataset. Analysis of massive dataset is challenging owing to formidable computational costs or memory requirements. A natural method is the averaging divide-and-conquer approach, which splits data into several blocks, obtains the estimators for each block and then aggregates the estimators via averaging. However, there is a restriction on the number of blocks. To overcome this limitation, this paper proposed a computationally efficient method, which only requires an initial estimator and then successively refines the estimator via multiple rounds of aggregations. The proposed estimator achieves the optimal convergence rate without any restriction on the number of blocks. We present both theoretical analysis and experiments to explore the property of the proposed method.

Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/24754269.2022.2135807 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:tstfxx:v:7:y:2023:i:1:p:49-60

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/tstf20

DOI: 10.1080/24754269.2022.2135807

Access Statistics for this article

Statistical Theory and Related Fields is currently edited by Zhao Wei

More articles in Statistical Theory and Related Fields from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().