(Frisch-Waugh-Lovell)' On the Estimation of Regression Models by Row

Damian Clarke, Nicolás Paris Torres () and Benjamin Villena-Roldan
Additional contact information
Nicolás Paris Torres: University of Chile

No 16630, IZA Discussion Papers from IZA Network @ LISER

Abstract: We demonstrate that regression models can be estimated by working independently in a row-wise fashion. We document a simple procedure which allows for a wide class of econometric estimators to be implemented cumulatively, where, in the limit, estimators can be produced without ever storing more than a single line of data in a computer's memory. This result is useful in understanding the mechanics of many common regression models. These procedures can be used to speed up the computation of estimates computed via OLS, IV, Ridge regression, LASSO, Elastic Net, and Non-linear models including probit and logit, with all common modes of inference. This has implications for estimation and inference with 'big data', where memory constraints may imply that working with all data at once is particularly costly. We additionally show that even with moderately sized datasets, this method can reduce computation time compared with traditional estimation routines.

Keywords: big data; estimation; regression; matrix inversion (search for similar items in EconPapers)
JEL-codes: C55 C61 C87 (search for similar items in EconPapers)
Pages: 46 pages
Date: 2023-11
New Economics Papers: this item is included in nep-ecm and nep-ets
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://docs.iza.org/dp16630.pdf (application/pdf)

Related works:
Working Paper: (Frisch-Waugh-Lovell)': On the Estimation of Regression Models by Row (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp16630

Access Statistics for this paper

More papers in IZA Discussion Papers from IZA Network @ LISER Contact information at EDIRC.
Bibliographic data for series maintained by Mark Fallak ().