The case for repeatable analysis with energy economy optimization models

Joseph F. DeCarolis, Kevin Hunter and Sarat Sreepathi

Energy Economics, 2012, vol. 34, issue 6, 1845-1853

Abstract: Energy economy optimization (EEO) models employ formal search techniques to explore the future decision space over several decades in order to deliver policy-relevant insights. EEO models are a critical tool for decision-makers who must make near-term decisions with long-term effects in the face of large future uncertainties. While the number of model-based analyses proliferates, insufficient attention is paid to transparency in model development and application. Given the complex, data-intensive nature of EEO models and the general lack of access to source code and data, many of the assumptions underlying model-based analysis are hidden from external observers. This paper discusses the simplifications and subjective judgments involved in the model building process, which cannot be fully articulated in journal papers, reports, or model documentation. In addition, we argue that for all practical purposes, EEO model-based insights cannot be validated through comparison to real world outcomes. As a result, modelers are left without credible metrics to assess a model's ability to deliver reliable insight. We assert that EEO models should be discoverable through interrogation of publicly available source code and data. In addition, third parties should be able to run a specific model instance in order to independently verify published results. Yet a review of twelve EEO models suggests that in most cases, replication of model results is currently impossible. We provide several recommendations to help develop and sustain a software framework for repeatable model analysis.

Keywords: Energy modeling; Open source; Verification; Validation (search for similar items in EconPapers)
JEL-codes: C61 C68 C88 C90 (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (49)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0140988312001405
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:eneeco:v:34:y:2012:i:6:p:1845-1853

DOI: 10.1016/j.eneco.2012.07.004

Access Statistics for this article

Energy Economics is currently edited by R. S. J. Tol, Beng Ang, Lance Bachmeier, Perry Sadorsky, Ugur Soytas and J. P. Weyant

More articles in Energy Economics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().