Simple graphical criteria for selection bias in general-population and selected-sample treatment effects

Maya B Mathur and Ilya Shpitser

No 65dju, OSF Preprints from Center for Open Science

Abstract: When analyzing a non-representative sample selected from a general population, estimated average treatment effects (ATEs) can be biased relative to not only the causal ATE for the general population, but also relative to the ATE for the selected sample. When the treatment could affect selection, different individuals comprise the selected sample when the treatment is hypothetically set to different levels. Thus, defining estimands of interest in the selected sample and establishing identification criteria has been challenging. We consider ATEs in the general population and the selected sample as well the net treatment difference, which compares average potential outcomes between the counterfactual selected samples in a world with all members of the general population treated versus a world with no members treated. We provide graphical criteria for each estimand to be nonparametrically identified, which are easily assessed using a standard single-world intervention graph. Others decomposed bias relative to the general-population ATE into: (1) bias in the ATE for the (factual) selected sample; and (2) bias due to effect heterogeneity by selection status. We provide an alternative two-way decomposition using the net treatment difference, allowing each source of bias to be assessed unambiguously in a graph, even when the treatment affects selection.

Date: 2023-04-24
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://osf.io/download/6446bd0c18ff9141560482d9/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:65dju

DOI: 10.31219/osf.io/65dju

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().