Model Evaluation for Policy Insights: Reflections on the Forum Process

Hillard G. Huntington

MPRA Paper from University Library of Munich, Germany

Abstract: Model evaluation is best considered as a process for communicating with the policymaking or policy-advising community. Six decades of energy modelling have witnessed increasing complexity in these systems, a situation that raises a number of important challenges in using them effectively in policymaking organizations. When used as a learning rather than forecasting tool, these systems can be evaluated individually one by one or through joint efforts to compare them in multi-model exercises. After summarizing the evolution of energy modelling and efforts to evaluate them since the first oil embargo, this essay provides a guide to future evaluation collaborations by highlighting a few challenges that would improve the value of these studies for the policymaking community. These challenges range broadly and cover topics such as enhancing the engagement of the model user, ventilating the models’ complexity with intuitive insights, using simple models to demonstrate key parameters or responses, applying judicious occasional meta-analysis when there is value added, reporting model responses and calibrating them for decisionmakers, considering retrospective evaluation for a past period (when possible), selecting standardized or modeler-choice baseline conditions, selectively developing policy or diagnostic alternative cases, and institutionalising the model evaluation process for a specific topic or region.

Keywords: Energy Policymaking; Model Evaluation; Model Comparison (search for similar items in EconPapers)
JEL-codes: C54 Q41 Q54 (search for similar items in EconPapers)
Date: 2021-06-01
New Economics Papers: this item is included in nep-ene
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://mpra.ub.uni-muenchen.de/108691/1/MPRA_paper_108691.pdf original version (application/pdf)

Related works:
Journal Article: Model evaluation for policy insights: Reflections on the forum process (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pra:mprapa:108691

Access Statistics for this paper

More papers in MPRA Paper from University Library of Munich, Germany Ludwigstraße 33, D-80539 Munich, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Joachim Winter ().