Inference on Multiple Winners with Applications to Microcredit and Economic Mobility

Andreas Petrou-Zeniou and Azeem Shaikh

Papers from arXiv.org

Abstract: While policymakers and researchers are often concerned with conducting inference based on a data-dependent selection, a strictly larger class of inference problems arises when considering multiple data-dependent selections, such as when selecting on statistical significance or quantiles. Given this, we study the problem of conducting inference on multiple selections, which we dub the inference on multiple winners problem. In this setting, we encounter both selective and multiple testing problems, making existing approaches either not applicable or too conservative. Instead, we propose a novel, two-step approach to the inference on multiple winners problem, with the first step modeling the selection of winners, and the second step using this model to conduct inference only on the set of likely winners. Our two-step approach reduces over-coverage error by up to 96%. We apply our two-step approach to revisit the winner's curse in the creating moves to opportunity (CMTO) program, and to study external validity issues in the microcredit literature. In the CMTO application, we find that, after correcting for the inference on multiple winners problem, we fail to reject the possibility of null effects in the majority of census tracts selected by the CMTO program. In our microcredit application, we find that heterogeneity in treatment effect estimates remains largely unaffected even after our proposed inference corrections.

Date: 2024-10, Revised 2025-03
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://arxiv.org/pdf/2410.19212 Latest version (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:arx:papers:2410.19212

Access Statistics for this paper

More papers in Papers from arXiv.org
Bibliographic data for series maintained by arXiv administrators (help@arxiv.org).