A proposal of an indicator for quantifying model robustness based on the relationship between variability of errors and of explored conditions

R. Confalonieri, S. Bregaglio and M. Acutis

Ecological Modelling, 2010, vol. 221, issue 6, 960-964

Abstract: The evaluation of biophysical models is usually carried out by estimating the agreement between measured and simulated data and, more rarely, by using indices for other aspects, like model complexity and overparameterization. In spite of the importance of model robustness, especially for large area applications, no proposals for its quantification are available. In this paper, we would like to open a discussion on this issue, proposing a first approach for a quantification of robustness based on the variability of model error to variability of explored conditions ratio. We used modelling efficiency (EF) for quantifying error in model predictions and a normalized agrometeorological index (SAM) based on cumulated rainfall and reference evapotranspiration to characterize the conditions of application. Population standard deviations of EF and SAM were used to quantify their variability. The indicator was tested for models estimating meteorological variables and crop state variables. The values provided by the robustness indicator (IR) were discussed according to the models’ features and to the typology and number of processes simulated. IR increased with the number of processes simulated and, within the same typology of model, with the degree of overparameterization. No correlation were found between IR and two of the most used indices of model error (RRMSE, EF). This supports its inclusion in integrated systems for model evaluation.

Keywords: Model evaluation; Air relative humidity; Modelling efficiency; WARM; CropSyst (search for similar items in EconPapers)
Date: 2010
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0304380009008333
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ecomod:v:221:y:2010:i:6:p:960-964

DOI: 10.1016/j.ecolmodel.2009.12.003

Access Statistics for this article

Ecological Modelling is currently edited by Brian D. Fath

More articles in Ecological Modelling from Elsevier
Bibliographic data for series maintained by Catherine Liu ().