Lost in the design space? Construct validity in the microfinance literature

Lise Masselus, Christina Petrik and Jörg Peters

No 1097, Ruhr Economic Papers from RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen

Abstract: While results from individual Randomized Controlled Trials (RCTs) often do not hold beyond their setting, the accumulation of many RCTs can be used to guide policy. But how many studies are required to confidently generalize? Our paper examines construct validity, an often neglected yet important element affecting generalizability. Construct validity deals with how the operationalization of a treatment corresponds to the broader construct it intends to speak to. The universe of potential operationalizations is referred to as the design space. As an empirical example, we review 45 microfinance RCTs to estimate the size of the design space and to underpin that variations in the treatment operationalization matter for the observed effects. We also show that most papers nevertheless generalize from the operationalized treatment to a broad construct, mostly without acknowledging underlying assumptions, and many lack a transparent reporting of construct validity-relevant features.

Keywords: Causal inference; generalizability; meta-science; microfinance (search for similar items in EconPapers)
JEL-codes: A11 C18 C93 D04 O12 O16 (search for similar items in EconPapers)
Date: 2024
New Economics Papers: this item is included in nep-ecm and nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/302180/1/1900648687.pdf (application/pdf)

Related works:
Working Paper: Lost in the Design Space? Construct Validity in the Microfinance Literature (2024)
Working Paper: Lost in the Design Space? Construct Validity in the Microfinance Literature (2024)
Working Paper: Lost in the Design Space? Construct Validity in the Microfinance Literature (2024)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:rwirep:302180

DOI: 10.4419/96973274

Access Statistics for this paper

More papers in Ruhr Economic Papers from RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().