Characterisation and Calibration of Multiversal Models

Giulio Giacomo Cantone and Venera Tomaselli

No pa98g, MetaArXiv from Center for Open Science

Abstract: The Multiverse is a framework to design multi-model estimation where data are fit on many connected specifications of the same abstract model instead of a singular or a small selection of specifications. Differently from canonical multi-model, in Multiverse the probabilities of the specifications to be included in the analysis are never assumed independent of each other. Grounded in this consideration, this study provides a compact statistical characterisation of the process of elicitation of the specifications in Multiverse Analysis and conceptually adjacent methods, connecting previous insights from meta-analytical Statistics, model averaging, Network Theory, Information Theory, and Causal Inference. The topic of calibration of the multiversal estimates is treated with references to the adoption Bayesian Model Averaging vs. alternatives. In an application, it is checked the theory that Bayesian Model Averaging reduces error for well-specified multiversal models, but it amplifies it when a collider variable is included in the multiversal model. In well-specified models, alternatives do not perform significantly better than Uniform weighting of the estimates, so the adoption of a gold standard remains ambiguous. Normative implications for misinterpretation of the epistemic value of Multiverse Analysis and the connection of the proposed characterisation and future directions of research are discussed.

Date: 2024-04-24
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://osf.io/download/6627aeecc5851a0791f66f6c/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:metaar:pa98g

DOI: 10.31219/osf.io/pa98g

Access Statistics for this paper

More papers in MetaArXiv from Center for Open Science
Bibliographic data for series maintained by OSF ().