Quantitative probing: Validating causal models with quantitative domain knowledge

Grünbaum Daniel (), Stern Maike L. and Lang Elmar W.
Additional contact information
Grünbaum Daniel: ams OSRAM Group/University of Regensburg, 93055 Regensburg, Germany
Stern Maike L.: ams OSRAM Group, 93055 Regensburg, Germany
Lang Elmar W.: Department of Physics, University of Regensburg, 93053 Regensburg, Germany

Journal of Causal Inference, 2023, vol. 11, issue 1, 23

Abstract: We propose quantitative probing as a model-agnostic framework for validating causal models in the presence of quantitative domain knowledge. The method is constructed in analogy to the train/test split in correlation-based machine learning. It is consistent with the logic of scientific discovery and enhances current causal validation strategies. The effectiveness of the method is illustrated using Pearl’s sprinkler example, before a thorough simulation-based investigation is conducted. Limits of the technique are identified by studying exemplary failing scenarios, which are furthermore used to propose a list of topics for future research and improvements of the presented version of quantitative probing. A guide for practitioners is included to facilitate the incorporation of quantitative probing in causal modelling applications. The code for integrating quantitative probing into causal analysis, as well as the code for the presented simulation-based studies of the effectiveness of quantitative probing are provided in two separate open-source Python packages.

Keywords: causal model validation; causal inference; causality (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1515/jci-2022-0060 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:causin:v:11:y:2023:i:1:p:23:n:1019

DOI: 10.1515/jci-2022-0060

Access Statistics for this article

Journal of Causal Inference is currently edited by Elias Bareinboim, Jin Tian and Iván Díaz

More articles in Journal of Causal Inference from De Gruyter
Bibliographic data for series maintained by Peter Golla ().