Using Machine Learning and Qualitative Interviews to Design a Five-Question Women's Agency Index

Seema Jayachandran, Monica Biradavolu and Jan Cooper
Additional contact information
Monica Biradavolu: QualAnalytics
Jan Cooper: Harvard University

No 14221, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: We propose a new method to design a short survey measure of a complex concept such as women's agency. The approach combines mixed-methods data collection and machine learning. We select the best survey questions based on how strongly correlated they are with a "gold standard" measure of the concept derived from qualitative interviews. In our application, we measure agency for 209 women in Haryana, India, first, through a semi-structured interview and, second, through a large set of close-ended questions. We use qualitative coding methods to score each woman's agency based on the interview, which we treat as her true agency. To identify the close-ended questions most predictive of the "truth," we apply statistical algorithms that build on LASSO and random forest but constrain how many variables are selected for the model (five in our case). The resulting five-question index is as strongly correlated with the coded qualitative interview as is an index that uses all of the candidate questions. This approach of selecting survey questions based on their statistical correspondence to coded qualitative interviews could be used to design short survey modules for many other latent constructs.

Keywords: women's empowerment; survey design; feature selection; psychometrics (search for similar items in EconPapers)
JEL-codes: C83 D13 J16 O12 (search for similar items in EconPapers)
Pages: 50 pages
Date: 2021-03
New Economics Papers: this item is included in nep-big, nep-cmp and nep-cwa
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (13)

Downloads: (external link)
https://docs.iza.org/dp14221.pdf (application/pdf)

Related works:
Working Paper: Using Machine Learning and Qualitative Interviews to Design a Five-Question Women's Agency Index (2021)
Working Paper: Using machine learning and qualitative interviews to design a five-question women's agency index (2021)
Working Paper: Using Machine Learning and Qualitative Interviews to Design a Five-Question Women's Agency Index (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp14221

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().