Merging validation and evaluation of ecological models to ‘evaludation’: A review of terminology and a practical approach
Jacqueline Augusiak,
Paul J. Van den Brink and
Volker Grimm
Ecological Modelling, 2014, vol. 280, issue C, 117-128
Abstract:
Confusion about model validation is one of the main challenges in using ecological models for decision support, such as the regulation of pesticides. Decision makers need to know whether a model is a sufficiently good representation of its real counterpart and what criteria can be used to answer this question. Unclear terminology is one of the main obstacles to a good understanding of what model validation is, how it works, and what it can deliver. Therefore, we performed a literature review and derived a standard set of terms. ‘Validation’ was identified as a catch-all term, which is thus useless for any practical purpose. We introduce the term ‘evaludation’, a fusion of ‘evaluation’ and ‘validation’, to describe the entire process of assessing a model's quality and reliability. Considering the iterative nature of model development, the modelling cycle, we identified six essential elements of evaludation: (i) ‘data evaluation’ for scrutinising the quality of numerical and qualitative data used for model development and testing; (ii) ‘conceptual model evaluation’ for examining the simplifying assumptions underlying a model's design; (iii) ‘implementation verification’ for testing the model's implementation in equations and as a computer programme; (iv) ‘model output verification’ for comparing model output to data and patterns that guided model design and were possibly used for calibration; (v) ‘model analysis’ for exploring the model's sensitivity to changes in parameters and process formulations to make sure that the mechanistic basis of main behaviours of the model has been well understood; and (vi) ‘model output corroboration’ for comparing model output to new data and patterns that were not used for model development and parameterisation. Currently, most decision makers require ‘validating’ a model by testing its predictions with new experiments or data. Despite being desirable, this is neither sufficient nor necessary for a model to be useful for decision support. We believe that the proposed set of terms and its relation to the modelling cycle can help to make quality assessments and reality checks of ecological models more comprehensive and transparent.
Keywords: Model validation; Terminology; Decision support; Documentation; Ecological models; Risk assessment (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (50)
Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0304380013005450
Full text for ScienceDirect subscribers only
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:eee:ecomod:v:280:y:2014:i:c:p:117-128
DOI: 10.1016/j.ecolmodel.2013.11.009
Access Statistics for this article
Ecological Modelling is currently edited by Brian D. Fath
More articles in Ecological Modelling from Elsevier
Bibliographic data for series maintained by Catherine Liu ().