Data Nuggets in Supervised Learning

Kenneth Edward Cherasia (), Javier Cabrera (), Luisa T. Fernholz () and Robert Fernholz ()
Additional contact information
Kenneth Edward Cherasia: Rutgers University, Department of Statistics
Javier Cabrera: Rutgers University, Department of Statistics
Luisa T. Fernholz: Temple University, Department of Statistics
Robert Fernholz: Intech Corp.

A chapter in Robust and Multivariate Statistical Methods, 2023, pp 429-449 from Springer

Abstract: Abstract Big data presents many challenges in modern statistics and data analysis. While a large number of observations can lead to increased precision in statistical parameter estimation and prediction, computational and storage costs may present a problem. Since there is often significant redundancy in large data in a lower dimensional setting, it seems reasonable that big datasets can be compressed to a smaller number of observations with comparable statistical performance, where the amount of compression scales with the dimensionality. We propose an extension of the “data nuggets” methodology of Beavers et al. (2020) for a compression-based approach to statistical modeling in big data. We utilize the linear regression model to showcase the idea, establish a theoretical foundation, and explore finite-sample performance via simulation analysis. Data nuggets are shown to provide a significant improvement over random sampling in model parameter estimation and out-of-sample prediction performance in the linear regression setting, and the concept is promising for other models as well.

Keywords: Big data; Data nuggets; Supervised learning; Asymptotic efficiency (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-031-22687-8_20

Ordering information: This item can be ordered from
http://www.springer.com/9783031226878

DOI: 10.1007/978-3-031-22687-8_20

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().