Promoting reproducibility and increased collaboration in electric sector capacity expansion models with community benchmarking and intercomparison efforts

Candise L. Henry, Hadi Eshraghi, Oleg Lugovoy, Michael B. Waite, Joseph F. DeCarolis, David J. Farnham, Tyler H. Ruggles, Rebecca A.M. Peer, Yuezi Wu, Anderson de Queiroz, Vladimir Potashnikov (), Vijay Modi and Ken Caldeira

Applied Energy, 2021, vol. 304, issue C, No S0306261921010916

Abstract: Electric sector capacity expansion models are widely used by academic, government, and industry researchers for policy analysis and planning. Many models overlap in their capabilities, spatial and temporal resolutions, and research purposes, but yield diverse results due to both parametric and structural differences. Previous work has attempted to identify some differences among commonly used capacity expansion models but has been unable to disentangle parametric from structural uncertainty. Here, we present a model benchmarking effort using highly simplified scenarios applied to four open-source models of the U.S. electric sector. We eliminate all parametric uncertainty through using a common dataset and leave only structural differences. We demonstrate how a systematic model comparison process allows us to pinpoint specific and important structural differences among our models, including specification of technologies as baseload or load following generation, battery state-of-charge at the beginning and end of a modeled period, application of battery roundtrip efficiency, treatment of discount rates, formulation of model end effects, and digit precision of input parameters. Our results show that such a process can be effective for improving consistency across models and building model confidence, substantiating specific modeling choices, reporting uncertainties, and identifying areas for further research and development. We also introduce an open-source test dataset that the modeling community can use for unit testing and build on for benchmarking exercises of more complex models. A community benchmarking effort can increase collaboration among energy modelers and provide transparency regarding the energy transition and energy challenges, for other stakeholders such as policymakers.

Keywords: Capacity expansion models; Model benchmarking; Energy; Optimization models; Electricity systems (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0306261921010916
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:appene:v:304:y:2021:i:c:s0306261921010916

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/bibliographic
http://www.elsevier. ... 405891/bibliographic

DOI: 10.1016/j.apenergy.2021.117745

Access Statistics for this article

Applied Energy is currently edited by J. Yan

More articles in Applied Energy from Elsevier
Bibliographic data for series maintained by Catherine Liu ().