Inference for regression with variables generated from unstructured data

Laura Battaglia, Timothy M. Christensen, Stephen Hansen and Szymon Sacher

No 10/24, CeMMAP working papers from Institute for Fiscal Studies

Abstract: The leading strategy for analyzing unstructured data uses two steps. First, latent variables of economic interest are estimated with an upstream information retrieval model. Second, the estimates are treated as “data” in a downstream econometric model. We establish theoretical arguments for why this two-step strategy leads to biased inference in empirically plausible settings. More constructively, we propose a one-step strategy for valid inference that uses the upstream and downstream models jointly. The one-step strategy (i) substantially reduces bias in simulations; (ii) has quantitatively important effects in a leading application using CEO time-use data; and (iii) can be readily adapted by applied researchers.

Date: 2024-05-08
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.cemmap.ac.uk/wp-content/uploads/2024/0 ... nstructured-data.pdf (application/pdf)

Related works:
Working Paper: Inference for Regression with Variables Generated from Unstructured Data (2024)
Working Paper: Inference for Regression with Variables Generated from Unstructured Data (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:azt:cemmap:10/24

DOI: 10.47004/wp.cem.2024.1024

Access Statistics for this paper

More papers in CeMMAP working papers from Institute for Fiscal Studies Contact information at EDIRC.
Bibliographic data for series maintained by Dermot Watson ().